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Editor's Preface 
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The structure of the social sciences combines two separate elements, 
theory and empirical evidence. Both are necessary for successful 
social understanding; one without the other is barren. The Contem- 
porary Social Research series is concerned with the means by which 
this structure is maintained and kept standing solid and upright, a job 
performed by the methodology ofsocial research. 

The series is intended to provide concise introductions to 
significant methodological topics. Broadly conceived, research 
methodology deals with the general grounds for the validity of social 
Science propositions. How do we know what we do know about the 
social world? More narrowly, it deals with the questions, how do we 
actually acquire new knowledge about the world in which we live? 
What are the strategies and techniques by means of which social 
Science data are collected and analysed? The series will seek to 
answer such questions through the examination of specific areas of 
methodology. 

Why is such a series necessary? There exist many solid, indeed 
massive, methodology textbooks, which most undergraduates in 
sociology, psychology and other social sciences acquire familiarity 
with in the course of their studies. The purpose of this series is 
different. Its aim is to focus upon specific topics, procedures, methods 
of analysis and methodological problems to provide a readable 
introduction to its subject. Each book contains annotated suggestions 
for further reading. The intended audience includes the advanced 
undergraduate, the graduate student, the working social researcher 
seeking to familiarise himself with new areas, and the non-specialist 
Who wishes to enlarge his knowledge of social research. Research 
methodology need not be remote and inaccessible. Some prior 
knowledge of statistics will be useful, but only certain titles in the 
Series will make strong statistical demands upon the reader. The 
Series is concerned above all to demonstrate the general importance 
andcentrality of research methodology to social science. 

The Survey Method is a particularly welcome contribution to 
methodological debate at the present time. The survey is probably 
the most widely used method of social research, but in recent years it 
has been the object of much damaging criticism, particularly by 
sociologists. Some critics have maintained, and not a few cohorts of 
Sociology students have been taught, that surveys are so vitiated by 
potential error that their value in social science research is limited. 
Catherine Marsh examines such claims, to show that much of this 
criticism is ignorant and ill-founded. Maintaining an important 
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distinction between the scientific survey and public opinion polling, 
she shows that the former has great potential for addressing major 
theoretical questions in social science. The Survey Method will help 


to re-establish the credentials of survey research among social 
scientists. 


MARTIN BULMER 
The London School of 
Economics and Political Science 
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Many people have given me support and encouragement while I have 
been writing this book. There are two overwhelming debts that I must 
recognise at the outset: first to Martin Bulmer for getting this book 
Started and secondly to Dave Marsh for getting it finished. Iam aware 
how time-consuming it is to get consistency between tables in even 
thecleanest data; George Brown went toa great deal oftrouble to help 
me get the figures in Chapter 5 right. Both Gill Sutherland and Jane 
Caplan tried to dissuade me from ‘first chapter history’, I know, but 
their thoughts on the second chapter were extremely valuable. 
Indeed, contact with them and another Newnham colleague, Pat 
Altham, who tries to keep me on the straight and narrow in statistics, 
seems to provide the perfect vindication of the college system. Others 
who have been especially helpful are: John Barnes, Nick Bateson, 
Bob Blackburn, Colin Brown, Tim Bryson, Jim Davis, Jeff Evans, 
Tirril Harris, Martin Harrop, Michael MacKuen, James Marsh, 
Louis Moss, Jennifer Platt, Alan Stuart and Charles Turner. Prefaces 
are a good place to record long-term debts that might otherwise be 
inadequately recognised. I should like to take this opportunity to 
record my thanks to John Utting, who taught me so much while I was 
at the Survey Unit. Most importantly, I must acknowledge the help 
and encouragement I have received from Geoffrey Hawthorn, from 
my undergraduate days when he was my supervisor, through to the 
present day when we work in the same department. He is a great 
teacher, a tireless colleague and a good friend. 
CATHIE MARSH 
Social and Political Sciences Committee 
University of Cambridge 
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Perhaps the best way to begin a book which aims to convince you, the 
reader, that survey research has an important and valuable contribu- 
tion to make to sociology, is with a bit of autobiography. My aim in 
telling you something of my own background does not stem from the 
Weberian injunction to forewarn you of my likely prejudices and 
values – I make no attempt to hide these in what follows — but to 
explain briefly how it came to pass that someone should end up with 
political and epistemological convictions seemingly so at odds with 
oneanother, by today's standards. 

I did my undergraduate degree at Cambridge University, doing the 
Social and Political Sciences Tripos as a Part Il subject. There was 
not then, nor is there now, a full three-year course in the social 
Sciences (see Bulmer 1981). This is partly due to the fact that 
Cambridge University has a history of resisting all innovations until 
they become unavoidable. It is partly due to the predominance of 
social anthropology, the social science of empire, in this ancient seat 
of learning. And it is partly to do with the association of the outburst 
of social scientific activity in the 1960s with political subversion. 

If it couldn't resist the advances of sociology, the university would 
have to pass it offas a brand of philosophy. The compulsory ‘research 
methods’ paper that everyone took in their finals could be answered 
using only material from the philosophy of the social sciences. I was 
lucky enough to have received encouragement to battle on with 
Statistics, but by the time I graduated, I had absorbed a sufficient 
amount of the prevailing Zeitgeist to be convinced that survey 
research was hopelessly empiricist, the product of vulgar American 
Sociology, atheoretical and generally a waste of time. 

I floundered for one year trying to organise a Ph.D., but it was very 
hard, given that I had only two year’s social sciences behind me, and 
given my strange views on methods. A fellow graduate student 
Suggested attending a summer school, organised by the Social Science 
Research Council’s Survey Unit, on survey research methods, and I 
decided, grudgingly, but in truth desperately, to go. It was an eye- 
opener, and the principal ocular surgeon was Professor Jim Davis, 
then director of the National Opinion Research Centre at Chicago. 
He gave a course of lectures on survey analysis, on the Lazarsfeldian 
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i i elate ina 

id f elaborating variables in a survey, which epe Fh riu 
a Me re direct way than anything I had heard be ane 
much mo I retained my rather arch views on other aspects е и 
pele a: I was hooked on this method on le n ИЕ 

З fter this- course, а job was adverti al 
Mee Acn Survey Unit, which offered the psum. ge ger 
training. The drive of intellectual curiosity Me е nio 
propelled me through my Ph.D. proved no match А aa. ii 
work as part ofa team, to be trained in a particular set pean! PUn 
honesty, to receive a wage! I worked, mainly in the app easily Веја 
in that Unit for two years, painfully unlearning my cmd ee 
prejudices on a variety of matters empirical. I became S и 
the depth of the ideological battle over methods in the se собе“ 
One had, on the one hand, to listen to the point of view о! T nds 
sional survey practitioners, who thought that survey ste нонни 
discipline in its own right, standing outside any of the socia T onte 
in a direct relationship to the policy-maker. One was "e S esi 
other hand, to harangues by sociologists on the utter worthles uei 
Surveys for any purpose. Neither 'side' seemed to acknow 


- ~ id there 
place for the Sociologist survey researcher, nor, indeed, did 
seem to be many role models around 


i ists tO 
among British sociologists 
we i fairly 
The Survey Unit had been set up in 1970 and mede ral 
explicitly on analogies with the National Opinion Researc t 


; ап; 
Chicago (Sheatsley 1978) or the Survey Research Center at Michig 
its aim was to becom 


made available thro 
involvement of mem 
Providing teaching. I ; red ! 
fire between the commercial market research world which fea 
might interfere 


E s T ed the 
governmental, and the Sociological community who resent 
funds required 


Tams, retired in 1976, th 
Commit such a | 


. 000 
»and closed the Unit. Instead they set aside a sum of £200, 
to fund applications t 


a A eve 
0 do methodological research, which has n 
ееп spent, 
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sociologists. That is the aim of this book. The majority of complaints 
that come from sociologists which parade as fundamental criticisms 
of survey research are, I believe, usually reactions to poorly designed, 
inadequately conceptualised and theorised, unpiloted or just ill- 
managed surveys, and the good survey practitioners are more aware 
of the problems and the solutions to those problems than most 
sociologists. It is true that there are a lot of such surveys around, of 
little or no sociological or even social value; the point I am making is 
that they do not have to be like that. 

The most common characterisation of the survey’s fundamental 
epistemological flaw is that it is inherently positivist. Many people 
recently have questioned the utility of this term as applied to current 
sociological practice (Cohen 1980; Tropp 1980; Platt 1981). It seems 
to have become little more than a term of abuse. Its application to 
survey research has been rather ill thought out. Not only do the critics 
believe that survey research is positivist, but they also imply that the 
current orthodoxy in funding bodies is also positivist in the same way, 
and that it gives special pride of place to survey research as a method, 
out of a misguided or even malevolent desire to turn sociology into 
some kind of technocratic science. It is questionable whether this has 
ever been the orthodoxy in British sociology, but it is certainly not the 
orthodoxy today. In fact, current orthodoxy among sociologists as a 
whole is a rather asinine mirror-image of this position; the survey is 
rejected out of hand as being incapable of producing any information 
worth having. Some go further, and argue that in fact science is 
ideology, measurement a fiction and rigour a joke. The stereotype of 
the survey researcher is of a senescent, plodding servant of the 
establishment who hasn’t yet quite caught up with the new and 
devastating revolutions that have taken place in the philosophy of 
science, 3 

This disdain for surveys seems to be confined to sociologists. In 
other disciplines, the use of survey research in the 1960s and 1970s 
‘underwent a dramatic period of growth. It is not as though survey 
research had not penetrated universities — geographers and planners 
have taken it up eagerly. The only systematic evidence available for 
the organisation of social research in Britain comes from a survey of 
funded social science research carried out by the SSRC Survey Unit 
in 1972 (Perry 1975). Sixty per cent of projects reported (that is, of the 
last five completed projects from each contacted institution) were 
surveys; the exact proportion should be treated with caution since the 
definition of ‘funded research’ predisposed the subject matter 
towards surveys. Surveys were more popular in non-university 
Organisations, even excluding market research where they con- 
Stituted virtually 100 per cent, than in university teaching 
departments and in university-based research units; the differences 
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cent. 
were not striking, however – 60 per cent as opposed ea is 
Unfortunately these results are not broken down ha ЫА 
cannot tell if this holds as true for sociology аѕапуо 
oy nes been estimated that the value of survey dons 
missioned in Britain in 1979 was £85 million a am елити 
1980). The Market Research Society has grown into n леви 
twice the size of the British Sociological Association arie L1: de 
the size of the Royal Statistical Society, as you see in i af apart 
not make hasty comparisons between rates of ps E SA 
organisations in Table 1.1 „as they were established at differ 


; ; arch 
Table 1.1 Membership of Organisations Connected with Social Rese: 
MRS RSS BSA | 
1949 66 2,064 n.y.f. 
1963 1,300 3,457 625 
1970 2,300 4,183 1,184 
1980 3,450 4,829 1,525 


*n.y.f=not yet formed. 


In 1979 a new ог 
Association, to ‘provi 


a 
opment and methodology, to prone to 
identity among social researchers, id for 
opment and use of social research as an isation 
nity planning’. Within one year this onse t 
had 634 members, the majority of whom are not university senta- 
had shown itself Prepared to take up professional and repre 


1 | r been 
tional functions on behalf of researchers that the BSA has neve 
Prepared to do.! 


nin 
Inshort, there isa vast new industry ofsurvey research. » que 
universities, but a large part of it goes on outside, in market id Com- 
companies and social research organisations like Social m ofthe 
munity Planning Research, Policy Studies Institute (the resu tre for 
merger between Political and Economic Planning and the а а 
Studies in Social Policy), in the Government Social Survey. h does 
ment of the Office of Population Censuses and Surveys whic nisa- 
Contract work for government departments, and in research ge he 
tions based within different government departments, such а for 
Home Office Research Unit and (until recently) the Е 
Environmental Studies. It is almost totally metropolitan in chara 
Servicing Policy-makers inone Way oranother. 
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But this growth in survey activity seems to have passed sociology 
by. Despite the existence of increased funding for social research ofa 
more basic, theoretical nature, and despite access to the improved 
technology of survey research which the growth of this industry has 
made available, the type of study that one might have expected to ensue 
from the changed situation failed to materialise (see Platt 1976). 

The survey activity that does go on in sociology departments is of 
low average quality. When survey results are reported in British 
sociology journals, the authors of the articles are usually North 
Americans (Harrop 1980). Some have felt that the only way to pull 
standards up is by putting more effort into training; indeed, this was 
what the Clapham Committee of 1946 recommended that money 
should be spent on. There are constant complaints from supervisors 
and employers of social researchers that an undergraduate sociology 
methods training leaves them completely green about how to con- 
duct research. The SSRC conducted two conferences on this problem 
in postgraduate training in 1979 alone. Yet, where training is laid on 
outside undergraduate or postgraduate departments, sociologists 
rarely take advantage of it, as we discovered in the SSRC Survey Unit 
summer schools, as the European Consortium for Political Research 
summer schools at Essex continue to find, and as centres like the 
Strathclyde Area Survey find when sociologists do not utilise the 
teaching resources they make available. 

In later chapters of this book I shall try to meet the critics among 
the sociologists who argue that the reason for this relative neglect 
stems from a quite correct appreciation on the part of sociologists of 
the value of surveys. But the fact that the critics have been so popular 
and that the doubts they raise have gained such wide currency should 
give pause for thought. There are several puzzles about this attitude. 
Britain has a tradition of some fine survey research — it is no 
American import. Moreover, in the postwar years there have been 
some good examples of major contributions to sociology based on 
survey findings. And when one casts one’s attention elsewhere in the 
globe, one discovers that sociologists in other countries have not 
eschewed the survey. In many ways this problem seems particularly 
British, and requires some knowledge of the development of social 
research in Britain before it can be fully understood. _ 

The strategy for this book, then, is to look at the history of survey 
research in Britain, to see if we can glean from it clues which might 
explain the current separation between sociology and survey 
research. After a variety of institutional, political and intellectual 
reasons for some of the developments have been noted, the criticisms 
of survey research will be rehearsed and addressed. In the following 
two chapters it will be argued that surveys can provide causal 
explanations and that they can provide meaningful explanations. 
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Fin T! h he is a profo d 
i i t there 1s p 

all yM the last chapter I shall argue tha а " 
difference between a sociological survey and an opinion pol 3 


i es 
suspect that much of the opprobium that attaches to surveys com 
from their association with polling. 


ition of a Surve pe 
дох а further, I must give some definition of ид је 
mean by this word ‘survey’. The word has a long pr cee с 
English language, and developed from being the fact of vie cec tel 
inspecting something in detail (as in a land survey) to the act o "es 
so rigorously and comprehensively, and finally to the written re om 
The idea of the social Survey started with this connotation о fut 
collection of social facts, but has undergone an evolution such int 
nowadays the survey method is not just a way of collecting data 
also ofanalysing the results. 


i ў igation 
For the purposes of this book, a survey refers to an investigat 
where: 


(a) systematic measurements 
a rectangle of data; 

(b) the variables in the matrix 
patterns; 

(c) the subject matter is social. 


^ A in 
аге made over a series of cases yieldi 8 


are analysed to see if they show any 


In other words, the surveys we sh 
method of data collecti 
Particular substance. 

The only restrictio 
data is to insist that it 


icular 
all be looking at have a pare 
on, a particular method of data analysis a 


n made on the survey as a method of collecting 
be systematic, looking at more than one vei те 
it individuals, hospitals, countries, or whatever, and meae a 
Same variables on each Case, so that you end up with each case en 
one and only one code for each variable. The data could come ire, 
observation, from fixed-choice responses to a postal Seong te 
from content analysis of newspapers, or Кот postcoding 


recorded depth interviews. The important thing is that there pem 
than one case and that variation between cases is consi 
Systematically. 'Surve 


f 5 

y analysis’ involves making casual ps 
from some kind of Passive observation programme. The mr 
Survey’ is sometimes used to refer to such investigations as a SP ta 
ballot question-wording trial, where there has been an experiment, 
manipulation, but I think it i 


А t 
: 5 clearer if we use the word ‘experimen 
to describe such investigations. to 
Surveys and experiments are the only two methods known to er 
test a hypothesis about how the world works. The experimen 
intervenes in the 50 


А : n 
cial world, does something to a set of subjects (а 
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usually also refrains from doing that thing to a set of controls) and 
looks to see what effect manipulating variance in the independent 
variable has on the dependent variable. If the subjects have been 
assigned in some fashion to control and experimental groups, the 
experimenter can be sure that it is what she did to the independent 
variable that has produced any differences between the groups. 

The survey researcher has only made a series of observations; to be 
sure, as we shall come on to argue, these cannot be seen as passive 
reflections of unproblematic reality, but they must be logically 
distinguished from the manipulation that the experimenter engages 
in. The only element of randomness in the survey design comes in 
random selection of cases; random sampling does not achieve the 
same result as random allocation into control and experimental 
&roups. The survey researcher may have a theory which leads her to 
Suspect that X is having a causal effect on Y. If she wants to test this, 
she has to measure X and Y ona variety of different subjects, and infer 
from the fact that X and Y covary that the original hypothesis was 
true. But unlike the experimenter, she cannot rule out the possibility 
in principle of there being a third variable prior to X and Y and 
causing the variance in both; the experimenter knows that the 
relationship is not spurious because she knows exactly what 
Produced the variance in X – she did. 

In other words, in survey research the process of testing causal 
hypotheses, central to any theory-building endeavour, is a very 
indirect process of drawing inferences from already existing variance 
in populations by a rigorous process of comparison. In practice, one 
of the major strategies of the survey researcher is to control for other 
variables that she thinks might realistically be held also to produce an 
effect, but she never gets round the purist's objection that she has not 
definitively established a causal relationship. Furthermore, although 
having panel data across time certainly helps with the practical 
resolution of the problem of how to decide which of one's variables 
are prior to which others, it does not solve the logical difficulty that, 
in principle, any relationship which one finds may be explained by 
the operation ofanother unmeasured factor. у z 
. Finally, the subject matter of the surveys that sociologists are 
interested in is always social. Many different disciplines collect 
Systematic observational data and make inferences from it. Biologists 
looking at correlations between plant growth and different types of 
environment, psychologists coding films of mother-child inter- 
actions, or astronomers drawing inferences about the origins of the 
universe from measurements of light intensity taken now, are all 
performing activities whose logic issimilarto that ofthe social survey 
analyst, but they would not describe their studies as ‘surveys’. 1 once 
analysed the product of one week's cuttings from all references in the 
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national and local newspapers and magazines to the word SUY. 
This produced a list of very different activities descibed as Ena ма 
a building society investigating house values, a local autho = 
checking up that hospitals were instituting adequate safety p 

cutions, commercial surveys of different markets, and soon. ка 

We are only talking about social surveys. But that still meanst 
the subject matter is very broadly defined; human social e A 
occurs and is supported in a wide variety of ways and settings. | | 
shall see in the next chapter, however, how some particular i den 
matters for social surveys have been so popular that various writer: 
have defined a survey more narrowly. : 

It may seem а bit pedantic to have spent so much time Worn 
about definitions — after all, it might be argued, we all have a dan 
idea of what a survey is. But when we are dealing with critics, it wil У 
useful to have some idea which of the criticisms surveys could na 
avoid, and which they share with other methods in the pe 
Sciences. It would be ironic if people were deciding against surv к. 
methods because of a dislike of structured questionnaires, or becau 


they thought that the only thing that surveys could be used for was 
town planning inquiries Or opinion polls. 


Note: Chapter 1 


5 : Р ment 
1 WS signs of being Prepared to take up the question of the employ 


It also sho: $ rs has 
problems of research workers which the Association of University Teache 
been slow to do. It willgrow rapidly. 
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History of the Use of Surveys in 
Sociological Research 


Methodologists are traditionally uninterested in the history of their 
subject (for example, Jones and Kronus 1976). This lack of interest is 
usually presumed to result from a belief in the cumulative and pro- 
gressive changes in knowledge. The assumption is ‘we know how to 
do surveys today so much better than they did 50 years ago that it 
cannot possibly be of more than antiquarian interest to know how 
people used to do them’. This view would be contested by those who 
believe that there is no way that the social sciences can claim to build 
their knowledge up to converge on methodological excellence or 
substantive truth. But even those who, like myself, believe that 
sociology can, and in some spheres does, acquire knowledge that can 
be cumulated, could still find reason to fault such a position. Unless 
we are convinced that the path taken to present understanding is the 
best possible, and that the practices of today are the best possible, we 
shall want to know something of the development of those practices. 
Apart from being intrinsically interesting, we havea specific question 
to try to answer, namely, how it came to pass that sociologists failed to 
take advantage of the enormous growth in social survey research. 

The survey was defined in the introduction as an inquiry which 
involves the collection of systematic data across a sample of cases, 
and the statistical analysis of the results. But is the history of surveys 
to be taken to be the history of the word, documenting the activities of 
those who did what they themselves described as a ‘survey’? If it is, 
Very little methodological continuity will be found in the activities to 
be described, for the word has been used to cover most types of 
empirical research at some point in time. It would be found to be 
mainly a history of data collection, for the self-styled ‘survey 
tradition’ has never been very analytic, as we shall see. In order to 
document the development of the causal logic now applied to survey 
data, it will be necessary to trace a rather different path. 

A rather arbitrary ordering would occur if I were to try to trace the 
development of the survey tradition and multivariate analysis 
simultaneously, so I have chosen to deal with them separately. This is 
unsatisfactory, because it gives the impression that the development 
of data collection and data analysis are unrelated, which is often not 
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i irecti 1 see 
the case. There can be spin-offs in both а 
і iti long time the tv 
les of this. But it is a fact that fora | E 
ае separate lines, and so must be given separate treatm 


(1) The ‘Survey Tradition’ of Fact-Finding 

am i ional 
а. with a bureaucracy of any complexity E oes 
data-gathering exercises in order to administer efficient у, 


i ians, 
manpower available for war and to levy taxes. The ancient Egypti 


Е our 
the Romans, the Chinese from the Ming dynasty onwards and 
own Normans all conducte 


d inquiries of this kind. But a ir n 
data-gathering became necessary with the birth of apn 5. es 
Zeisel points out in his afterthought to Marienthal, Almos olitical 
day on which the European feudal order suffered its first p 


> , et 
defeat became the birthday ofthe first sociographic study’ (Jahoda 
al. 1972: 100). 


census and civil record- 
The desire to assess the effects 


tty.! 
associated with the names of Graunt and Pe 
They used these bills 


> d to the 
olitical Observations with reference 


age-specifi 
Tegularities in 
Spur for the den 
katters, and is an early example of the fact that methodolog 
changes can th У ‘ed 
etty, who term ‘political arithmetic’, oa wn 
energetically for the Commonwealth, and undertook the (em 
urvey, the “first Sociographic Study’ that Zeisel referred to ear! 


a series of 
developme 
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detailed description of life and property in the newly conquered 
Ireland. He was a reformer who passionately believed that popula- 
tion studies would improve rational government, an early example of 
a would-be social physician.? After him, or perhaps after the rapid 
social change under the Commonwealth, it is a century and a half 
before any comparable work emerges. 

Fears that the home population had declined since the Glorious 
Revolution persisted throughout the eighteenth century, and on two 
Occasions crystallised into open polemic between the ‘optimists’ and 
‘pessimists’. The factual dispute was based on very thin evidence 
(which partly explains why it persisted so long); the method used to 
calculate the population was to estimate the number of houses from 
the numbers paying window tax and to multiply the estimate by the 
Presumed average family size. The results, not unnaturally, varied 
widely, and there were occasional calls for a census to settle the 
а but Parliament was not convinced it was necessary (Glass 

73). 

But at the beginning of the nineteenth century the rate of capitalist 
development increased sharply, and the debate about population was 
turned on its head by the publication in 1798 of Malthus’s Essay on 
Population. The population of Britain was growing at a phenomen- 
ally rapid rate, and the overcrowding in slum dwellings was bringing 
with it hitherto unimaginable problems of disease. The high-handed 
response of the church and aristocracy was utterly inadequate. There 
Was a growing fear, especially among the early industrialists, that the 
Poor, discontented with the promise of heavenly rewards, might 
become so morally depraved that they would ignore the teachings of 
the Bible and demand their just deserts in this life. Squalid prisons 
Were teeming with a new and frightening ‘criminal class’ of offenders 
against a whole barrage of new property laws, and a fair sprinkling of 
Innocent people as well; John Howard had been campaigning in the 
eighteenth century, collecting facts and figures of the numbers 
involved, to secure reform in these vile institutions. 

While pre-industrial Britain of the seventeenth and eighteenth 
Centuries had developed a long way beyond the golden age of Norman 
feudalism, it was still essentially a village society, where social con- 
ditions and relations were available for all to see. As capitalist 
relations spread socially and geographically, they broke up the face- 
to-face relations that existed between people, often effectively hiding 
One class from another; it became increasingly necessary to make a 
determined effort if one wanted to discover what was happening to 
the social structure. The new method of extracting a surplus, the 
factory system, hid the increased exploitation it brought about 

hind closed doors. There was a careful zoning of people with 
similar life-styles in the new towns and cities, so that there was 
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qualitative research. He wrote a series of articles for the Morning 
Chronicle in which he described the life situation of a wide variety of 
trades operating in London; these were later collected together in 
London Labour and the London Poor (1861). Recently it has become 
fashionable to argue that Mayhew was much more than a journalist – 
that he was a forerunner of Booth and as a social scientist in his 
methods (Yeo 1973). This is overdoing it; he certainly was concerned 
to be systematic, but his main method was still to collect qualitative 
information by sampling individual ‘representative’ cases. He did try 
to collect data that could be aggregated by calling meetings of 
Particular tradespeople and distributing questionnaires to them, but 
this was such an inadequate way of collecting systematic data that he 
must still rank as a journalist. 

There were, however, pressures on this form of investigation to 
become more systematic. Social exploration into the black 
continents in the centre of Britain’s cities continued and developed, 
but its results were always open to contestation. James Greenwood 
could horrify the readership of the Pall Mall Gazette with his 
accounts of a night spent disguised as a pauper in a workhouse in 
Lambeth, for which, incidentally, it was suggested that he be awarded 
the Victoria Cross! (Keating 1976: 15). A multitude of penny 
pamphlets could document the conditions of the poor of the cities. 
One pamphlet, Bitter Cry of Outcast London (Keating 1976: 
91-111), written by Andrew Mearns, a clergyman convinced that 
there was no point in expecting people in the depth of misery and 
Poverty to be religious until something was done about their physical 
needs, provoked a widespread controversy in the 1880s. Despite the 
assurances given by the author that what is described ‘is simply...a 
State of things which is found in house after house, court after court, 
Street after street’, the evidence of these inquiries was inconclusive 
and unsatisfactory; lone investigators of this kind could always be 
countered by other single examples which proved the opposite. 

Nevertheless, this style of ‘survey research’ continued into the 
twentieth century, and some examples still make fine reading. Lady 
Florence Bell, wife of a Middlesbrough steel-owner, wrote of her 
encounters with the workers who lived in her town; although this 

Ook is permeated with the patronising self-confidence of the owner’s 
wife, horrified, for example, at how the ignorant workers were feeding 
their children, it is still ultimately a sympathetic account (Bell 1907). 


The Early Victorian Period 7 A 

The liberal and utilitarian ideology of the new industrialists, which 
had replaced the hand of God with the hand of the market as the 
Providential regulator, did not prescribe how to deal with the 
immediate social problems that the capitalist market brought with it. 
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London Statistical Society was aliis exterendum – we collect the facts, 
others work out what they mean and what conclusions can be drawn 
from them. In fact, however, while publicly mouthing this catechism 
of objectivity, the sponsors of these surveys were committed to 
political positions; they rarely allowed inconvenient facts that did not 
fit in with their overall view to prevent them from campaigning for 
the reformsthat they thought necessary to prevent upheaval. 

Many of these inquiries were quite sophisticated and demonstrate 
knowledge ofthe use of precodes and percentages, and used carefully 
trained interviewers following a schedule (Elesh 1972). Some 
historians have wondered why these activities and methodological 
achievements were not continued into the mid-Victorian period. The 
explanation sometimes given is that they were not consolidated into 
research organisations capable of codifying their procedures, 
disseminating and cumulating their experience (Elesh 1972; Cole 
1972; Ben-David 1960). А 

This explanation does not go far enough, for it does not ask why 
they were not. A more complete explanation is given by remember- 
ing that these expensive investigations were conducted by individuals 
who, while wealthy, did not have limitless resources. And, although 
the ‘movement’ may have failed in as much as most of the statistical 
Societies petered out, it succeeded in persuading the government to 
take up these problems, to start routine data collection and ad hoc 
investigations of its own, and to regulate some of the worst excesses of 
industrialism through legislation (Cullen 1975). , x 

In 1837 the General Register Office was established, and civil 
registration of deaths was forced on an unwilling Parliament. During 
the 1840s regular statistical series were started on the number of 
births, deaths and crimes. Committees of inquiry were established 
into education and poverty; the first was the famous Royal 
Commission on the Poor Law, but by 1849 more than a hundred had 
been established, and a precedent had been set for the principle of 
always conducting an inquiry before major legislative changes were 
made. The modern census with household schedules was established 
in 1841 and the census of 1851 was a very wide-ranging and 
Sophisticated affair. The reformers were co-opted into government, 
Saton the various committees and staffed the General Register Office. 

One might imagine, from the current experience of our Social 
Survey Division at the Office of Population Censuses and Surveys, 
and from the experience of countries such as Sweden and India, that 
government might provide a very suitable location for organised 
Social research, for codifying research procedures, for providing the 
Possibility of such an organisation reaching a critical mass in terms of 
size, and for stimulating broader sociological questioning. But it 
Would appear that an additional ingredient is necessary, and that is 
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possible. The decisive factor was the formation of an organised 
labour movement capable of formulating demands, and eventually 
capable of sustaining a powerful enough struggle to achieve them. 
Beatrice Webb, however, would not have agreed. ʻA new 
consciousness of sin amongst men of intellect and property’, commit- 
ment to the values of a science of man, captivation by the positivist 
doctrines of Comte and his English disciples and ‘scientific curiosity 
... the desire to apply the method of observation, reasoning and 
Verification to the problem of poverty in the midst of riches’ were, in 
her estimation, what impelled the Liverpool shipping magnate 
Charles Booth to devote seventeen years of his life to seventeen 
volumes of The Life and Labour of the People of London (Webb 
1971; 1926: 187, 226). When, however, we inquire into the circum- 
Stances of Booth’s decision to embark on the project, we come to 
different conclusions. The traditional story that Booth was needled 
Into it by the Social Democrat Hyndman’s claim that 25 per cent of 
the people of London were in abject poverty has recently been 
questioned (Hennock 1976); nevertheless, whether there ever was 
such a Social Democratic Federation inquiry or whether the claim 
Was made in the Pall Mall Gazette, there is no doubt that Booth 
wanted to disprove the claims of this agitational literature, and, 
supported by a group of helpers (one of whom was Beatrice Webb, 
and from whose autobiography we get important insights into his 
Methodology), he undertook a piece of research which, in the end, 
covered 80 percent of the population of London. : 
One reason for the size of the project was the untheoretical nature 
of the inquiry; since there were no conclusions drawn from each 
Volume as it rolled in, describing in quantitative and qualitative 
terms the life ofthe inhabitants, there seemed to be nothing to do next 
ut to commence another inquiry (Glass 1955); Selvin (1976) 
endorses this view, and reckons that Booth’s greatest contribution to 
Social science was £30,000. The mythology about Booth is that he 
discovered that an even higher percentage, 30 per cent, were in 
Poverty, and so turned to campaigning for welfare reforms. In fact, his 
Classification system was so crude and impressionistic that it allowed 
im to interpret his own figures asa refutation of the ‘sensationalists 
Hennock 1976). | К 
he ‘success’ of the enterprise was not really in taking further an 
understanding of the causes of poverty. Apart from the blindingly 
55 ] labour and low earnings, there is 
from this marathon. Indeed, 
c surveys could never hope to 


Classes was hopelessly subjective. Nor can we accept the evaluation of 
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attempt to collect information about wages and rents from 25,451 
men of ‘Certain Selected Districts of London’ by means of a question- 
Naire which they filled in themselves, William Oglethorpe, then 
Superintendent of Statistics at the General Register office, virtually 
dismissed them in his introduction to the report: ‘after devoting much 
time and labour to a careful examination of the returns, and after 
informing myself fully as to the conditions under which the data were 
collected, I have come to the conclusions that these returns are of 
small Statistical value’ (Board of Trade 1888: Ixxi). А 
The idea of interviewing a respondent, who was at the same time 
the subject of the inquiry and the informant, was very slow to 
develop; one result of this was an almost total disregard for the 
Problems of question-wording. The investigators who chose this 
method were often the radical sympathisers with the working class. 
Karl Marx, in his Enquéte Ouvriére, recruited a volunteer sample 
from the Revue Socialiste, and asked them to fill in a hundred 
Open-ended questions about their conditions of work (Weiss 1936). 
The intention of this questionnaire was to raise important questions 
in the minds of those who answered them, as well as to provide 
Information for the investigator, so the questions are not at all 
neutral. One question, for example, asked workers to consider 
Whether those who worked in the so-called profit-sharing industries 
could go on strike ‘or are they only permitted to be the humble 
Servants of their masters?’ Marx had in mind that the results could be 
Presented as cahiers du travail like the cahiers de doléances of the 
French Revolution, and would form an agitational basis for 
Preparing a reconstruction of society’. In point of fact, there were so 
ew returns to the 25,000 questionnaires sent out that they were not 
Worth analysing — the methods of postal questionnaires have 
„пргоуед markedly since then! But the idea that surveys could have 
8n active politica] component for the respondents continued into the 
wea ofa ‘community self-survey' before and after the First World 
ar, and is being rediscovered today (Carr-Hill 1973; Institute for 
Orkers' Control 1977). 6 
© have mentioned that some inquiries of the early Victorian 
Movement made important methodological advances in question- 
пате design and the use of precodes. This aspect of the history of 
Survey research has been almost entirely neglected, and is an area 
сте the discontinuity and failure to consolidate and build on 
earlier achievements is most marked. To geta flavour of what I mean, 
i Comparing the two questionnaires on pp. 20-4, one from the 1845 
DQuiry into the parish of St George's in London's east end 
;-ommittee Investigating the Poorer Classes 1848), and one from m 
s Чшту іп 1919 in the city of Sheffield (St Phillips Settlement). The 
Systematic and careful way the evidence is collected in the 1845 
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inquiry compares very favourably with the vague and woolly 
instructions in the 1919 one; the former asks for details about 
clothing and reading material, where the latter just asks for 'aesthetic 
feelings". (On the reply printed as an example at the back ofthis latter 
inquiry the answer to this question was: ‘Nil. Rarely you see him with 
a collar on. Scarf twisted round his neck'!) It is only really since the 
widespread application of automatic data-processing technology, 
Hollerith cards, counter-sorters and computers to the analysis of 
survey results that major and sustained advances have been made in 
layout and precoding. 


Questionnaire 2 Inquiry in the city of Sheffield, St Phillip's Settlement, 1919 


STRICTLY PRIVATE 


Name ofhelper 

Address 

X's full name 

Exact address 

Sex Age 

Married, widoweror widowed, single 
Exact occupation 

Size oftenement occupied by family 
Precise mode of helper’s approach to X 


Educational Ideas 


What does X think of the WEA? 

Does X attend any classes, lectures, CCl а у 
What does X think about the education of his children? 
How does X regard the university? 

What is X'sopinion of education in general? 

Other information under I. 


Ф ол о — = 


~ 
~ 


Leisure 


How does X spend evenings? 

How does X spend free afternoons? 
How does X spend Sundays? | 

How does X spend annual holidays? 
What are X's hobbies? 

Whatare X'schiefamusements an 
Is X keen on garden orallotment? 
Other data under II. 


d pleasures? 
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Questionnaire 2 (cont.) 


ПІ Musical Tastes 


IV Aesthetic Feelings 


V Religious and Social Activities 
| IsXamember ofa trade union? 
2 IsXakeen member? 
3 IsXamemberofa Co-operative society? 
4 IsXatrue co-operator? 
5 IsXamemberofa Provident or friendly society? 
6 15 X a member ofany other club Or society? 
7 IsXamemberofa religious orsimilar organisation? 
8 Whatisthe value of X's membership? he 
9 What is the nature of X's relations with other members of t 
family? " 
10 Note any points that would serve to indicate X's goodness 0 
badness 
11 Whatis your personal impression ofX? 
12 Other data under V, 
VI Reading 
УП Home 


VIII Political Ideas 


- у PE е 
(With a view to Indicating X’s fitness for local and nationa 
citizenship.) 


IX Root Desires 
1 


1 What is X’s ambition? 


at would X do ifa millionaire? 
What would X like to do in old age? 


X Other Data 


Be "D ов сате round to the idea that there he 
gained from administering а questionnairi 
respondents, In Methods of Social Study the Webbe report that seed 
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tried sending a postal questionnaire to trade union officials, with little 
success (Webb and Webb 1975; 1932). Their response rate was low, 
and they had asked questions that they thought would make sense — 
"Do your members work at piece rate orat time rate?’ — but discovered 
that this question was unanswerable to the majority of officials who 
got their questionnaire. They were perhaps the first in a long line of 
people who decided that questionnaires had nothing interesting to 
offer, instead of concluding that if you intend to ask people structured 
questions of this kind you must do some very careful piloting. 

But another of Booth’s successors, Seebohm Rowntree, was more 
enthusiastic. Rowntree was, like Booth, a wealthy industrialist who 
decided to spend his money conducting an inquiry into poverty ina 
‘typical’ English town. He was a Quaker who had made his money in 
the cocoa and confectionery trade, and it was not surprising that he 
should select York as the town to be investigated, since it was a major 
centre of the chocolate industry. His work was much more 
sophisticated than Booth’s; he covered every wage-earning family 
where Booth had excluded those without schoolchildren, obtained 
the information directly from families by using interviewers and 
structured schedules, and refined the definition of poverty (Moser 
and Kalton 1971: 8). 4 
. Once the tradition of direct interviewing was established, other 
important methodological breakthroughs were made possible and 
necessary. The use of standard question-wording and standard 
definitions became vital. Rowntree had tried to give a physiologically 
based definition of poverty by attempting to define in terms of 
calories what a subsistence diet was, and then to calculate the sum 
Necessary to buy it. Being a major employer in the town, he had a 
harsh definition of subsistence; he defined ‘primary poverty as а 
situation where the family did not have enough income to meet this 
standard, and ‘secondary poverty’ as the situation where money was 
being diverted to strictly inessential items like furniture or drink. He 
was probably the first to combine LePlay’s method of collecting 
detailed family budgets with systematic interviewing of he 
Section of people. His findings agreed strikingly with Booth’s, nt 
where Booth had suggested vaguely that casual labour was associate 
With poverty, Rowntree pinpointed strong life-cycle effects bringing 
People out of and pushing them into poverty as their family circum- 
Stances changed. 


But it was Bowley who made the decisive methodological break- 


throughs for the social survey as we know it today. He was responsible 
fora much more rigorous attitude towards the precise questions to be 
asked and the precise definitions of the unit under investigation and 
the qualities sought of these units. | The Measurement of Social 
Phenomena (1915) was ahead of its time in an effort to standardise 
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definitions of such things as income, poverty, household and otta 
commonly used terms. The need for such standardisation -- a 
plagues survey research, and several international organisations ve 
tried to lay down standards in the way that Bowley did in graei. 

ensure compatibility across time and across nations. Unfortunately: 
there is a great deal of conservatism inevitable with designing 
classification Schemes; once you have committed yourself ~“ 
particular scheme for classifying Occupations, you will bray 
continue it just to see if things change over time. Only recently ha 


: : E А 5 
much effort been Put into making new classification system 
compatible with old ones. 


But Bowley is more с 
practical samp ing scheme to solve th 


their job as filling in the X 
eneral division of labour. 


necessary, but this usual] took t Ani icality for a” 
area studied, y he form of claiming typi 


The statistical ideas underly; i know? 
у ying random sampling had been 
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means in small samples with unknown standard deviations as early as 
1908, and he and Fisher discovered the theoretical distributions of 
large numbers of sample statistics before the First World War. 

For the application of these ideas to sampling procedures for 
surveys and to the estimation of likely errors, Bowley’s name is again 
supreme. He quickly understood the significance of discoveries of the 
properties of random samples, and in the studies of five English towns 
that he organised with the support of the Ratan Tata foundation in 
1913, he carefully drew up complete lists of houses and drew a 
random sample from this (Bowley and Burnett-Hurst 1915). In the 
last chapter of the report, he estimated the reliability of his findings 
and presented confidence intervals for the findings. Moreover, he had 
some intuitive understanding of the advantages of stratified random 
sampling, for he points out that in this estimation no allowance is 
being made for the fact that, because the addresses were originally 
ordered by street, one aspect of variance has been held constant and is 
not causing error. 

Thus before the First World War began, major advances had been 
made in the technology of surveying. The results of the surveys that 
were done at that time were published in the Journal of the Royal 
Statistical Society, however, and not in the newly founded Socio- 
logical Review. Neither Booth nor Rowntree would join the new 
Sociological Society, dominated as it was by two individuals, Patrick 
Geddes and Victor Branford, whose conception of sociology was 
Pervaded by their passionate interest in LePlay's theories and the 
Strange concept of 'civics', and whose idea of survey research was, as 
we shall see, different from the traditional poverty study. 

They would not even have been happy describing themselves as 
‘sociologists’, for this word connoted the attempt to erect grand social 
theories and explanatory schemes at variance with the dominant 
philosophy of social engineering which motivated the early poverty 
researchers. British sociology before the First World War utterly 
failed to agree on aims and objectives and to come together as an 
academic discipline (see Abrams 1968 for a masterly portrait of the 
intellectual and ideological battles). Bowley's activities would today 
come under the purview of economics. He and many of his successors 
were grappling with the problems of definition of national income, 
and the effect upon wages of various social insurance schemes. 


The Interwar Period 


It is hard to generalise about social and political conditions in the 


interwar years. The First World War had clinched the foundations of 
the welfare state; a safety net level of existence had been provided 
through national insurance. The laissez-faire economic system had 
irretrievably collapsed and the British ruling class was involved in 
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managing an increasingly highly centralised financial empire. The 
imminent threat of Bolshevism worried political leaders after the 
war; welfare reforms were continued and new ones granted. But in 
later 1920s this threat seemed to have subsided, and, after a period o 

intense unrest and industrial conflict, the morale of the labour 
movement was effectively sapped in the defeat of the General Strike. 
Unemployment and recession deepened throughout the period, and 
yet some industries and areas were undergoing expansion – the de 
industry and the south-east, for example, grew throughout the period. 
While the majority of workers were unemployed in some of the 
traditional areas of heavy industry, in other areas their wages were 
buying a new range of mass-produced goods — processed foods, 
radios, make-up, motorbicycles, and so on. 

A thorough assessment of the social research of the interwar years 
has not yet been made. A recent historian of the period opens his 
book with the ringing words, ‘The inter-war period in Britain was one 
of the great achievements in the fi 
tion’ (Stevenson 1977: 7). There were, it is true, a great many more 
surveys being done than ever before, and they have yielded unique 
data for the social historia 
to connect with the Pressing social problems ofthe day. 

In this period the state 
Social research in universiti 
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with the co-operation of a sociologist, a Dr Wagner who had worked 
with Lazarsfeld and his associates in Marienthal, was particularly 
sensitive (Pilgrim Trust 1938). The investigations performed by the 
state attempted to estimate how many people were being supported 
by various forms of insurance, but they were mainly concerned to 
Provide demographic information. John Hilton, first Director of 
Statistics at the Ministry of Labour, argued that the picture of 
unemployment which was obtainable from the official returns was 
inadequate. He organiseda | percent sample survey, administered by 
Labour Exchange officials, to get an age and industry profile of the 
unemployed. But, given the scale of the problem, the research is 
depressingly meagre. 

The only major area recognised as a ‘social problem’ was housing. 
As in the 1830s, attention was focused not on industry, but on the 
existence of terrible slums in all Britain’s major cities, many without 
water or drainage. The interwar period witnessed the rapid growth of 
sprawling and unplanned housing estates, and people were being 
forced to travel further and further to work. Philanthropists and 
active municipal authorities threw their energies into injecting a 
greater element of planning to control this urban sprawl. The town 
Planning movement was gaining sway under such pioneers as 
Abercrombie. Quaker philanthropists and other ‘model employers 

есате very enthusiastic about providing adequate housing. The 
number of housing surveys grew rapidly. У 

George Cadbury established the Bournville Village on the outskirts 
of Birmingham at the turn of the century, to be managed by a Trust 
which had more general philanthropic aims. This Trust conducted a 
comprehensive survey of housing conditions in Birmingham at the 
епа of the 1930s, and many similar surveys were conducted else- 
Where, in Becontree and Dagenham by Terence Young, and in 
Watling by a young woman then known as Ruth Durant but who was 
lo become the best of the postwar urban sociologists under the name 
of Ruth Glass. Where the state involved itself in these research 
activities, it can be criticised for using research to whitewash and 
contain social problems. A marathon attempt to survey the housing 
ofall working class homes was undertaken by local authorities in the 
winter of 1935-6, charged under the 1935 Housing Act to deal with 
Overcrowding (White 1977). Because the standards set under this act 
were so inadequate, it concluded that only 4 per cent of working class 

àmilies lived in overcrowded conditions. Р 
.. Very few further methodological developments took place in the 
interwar years. The mood of the day was a kind of institutional 
Sobriety. The task of social surveys was to act as a tool in a rational 

Ureaucracy, filling in the cracks of administrative ignorance, 
encouraging the compilation of books like А Survey of the Social 
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Structure of England and Wales by Carr-Saunders and Jones (Ist edn 
1927, 2nd edn 1937). This is an early prototype of Social Trends, a 
Statistical abstract of contemporary social data ‘from the morpho- 
logical point of view’, covering a range of topics from vital statistics, 
housing and industrial composition to crime and intelligence. у 
David Caradog Jones of the University of Liverpool, and chief 
investigator in the Social Survey of Merseyside at the end of the 
1920s, summed up the prevailing view of social surveys ina textbook 
he wrote after the Second World War (Jones 1948). The primary aim 
of a social survey, he tells us, ‘is to make an accurate and impartial 
collection and presentation of the facts’, because ‘the administration 
of government, the development of new ideas to be translated into 
action, the reform of evils, all depend upon accurate knowledge of 
existing conditions’ (Jones 1948: 11). In order to achieve such an 
impartial collection, investigators had to stick to objectively 
ascertainable conditions; they were very careful to distinguish this 
activity from opinion Surveys and from the community or regional 
Surveys associated with Branford and Geddes which we shall discuss 
shortly (Carr-Saunders 1934; Jones 1948). The idea that surveys 
should be factual had been accepted in principle by all those in the 


‘survey tradition’, but in this period the range of the factual domain 
became severely curtailed. 


The major interwar 
Bowley repeated his fj 


from the census, and suggeste 
to be that they were done in the 


hat strange phenomenon of early 
SA knownas the ‘community self- 
nsurance of various kinds was even 
Brew into a huge movement, into 
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which early Christian-reformer-sociologists threw themselves with 
great zeal (see Burgess 1916 for a programmatic statement). The 
movement is well described in early editions of Pauline Young’s 
methods textbook (1939). She looks enviously at Britain and wishes 
that the US survey movement could be equally ‘successful’ (she had 
read Webb's erroneous account of the effect of Booth's study); this is 
ironic, for the externality of the American movement from govern- 
ment allowed it to maintain its vitality much longer. 

The community survey movement had its intellectual origins in 
the thinking of Patrick Geddes, a remarkable blending of the survey 
methods of the French sociologist LePlay who was concerned above 
all else with family budgets, and the theories of organic social 
integration of Spencer and Comte. His aim was to show by survey 
methods how the family and the community were the twin pillars of 
Social integration in their ecological setting. The survey was done to 
arouse community feeling as much as for scientific purposes. It was to 
be organised not from within universities but from the communities 
themselves, conducted not by paid officials but by volunteers, and 
often culminated in an exhibition in the local town hall. The kind of 
Patchy urban anthropology that resulted from this movement has 
been Toundly criticised by Ruth Glass, who is scathing of the 
laborious obviousness of its findings, typical among which was the 

discovery" that women who do not work have more acquaintances 1п 
their neighbourhood than do women who work (Glass 1955). — 

The charter for the use of the social survey for a new sociology 
known as ‘civics’ is an article by Branford, Geddes's most devoted 
disciple, in the Sociological Review of 1912. The task of the survey 
15 to provide a social map, gathering the social and cultural fragments 
Omitted by cartographers and surveys like Booth’s. The aim is to 

make us see Eutopia, and, seeing it, to create it’, and Branford called 
Or the ‘socialisation of the Ordnance Survey and emancipation of the 
a yn. for human service’. 
was all thi ia that prol і Е 
Social Ма ei nM Pe link betwee the ideas of mapping 
and the idea of doing a survey was not the product of the community 
Survey; the aim of many investigators had been to describe the social 


landscape (and, indeed, the original meaning of the word ‘survey’ has 


this connotation). Booth had presented his main findings in the form 


9f beautiful maps i d to represent the residential 
, symbolically coloure у 

areas of the different social classes. Jones (1931: 566) hag also 

Suggested a regular social mapping of the different regions of Britain 


by specially appointed registrars. The main regional surveys of the 


interwar years were infused with this kind of thinking. 
Th iti er died with its founders. With 
. l'he Geddes/Branford tradition prop aoe a UM 


lts strange views on the essence of sociology, 


bably put the more sober 
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university base and its weak methodology, it must carry a 
burden of responsibility for convincing a generation of je 
sociologists that surveys were not for them. Its traces may be 5 
covered in the development of more systematic town сови 
surveys which even today account fora large proportion of the Suna 
industry, and the ‘community study’ tradition which receiver des 
postwar embodiment in the Institute of Community Studies. Neit ~ 
makes analytic use of surveys for answering sociological questions. h 
the latter case, the explanatory component is supplied by dept 
interviews with respondents in parallel with the more demographic 
survey material (Platt 1971). be 
By the beginning of the Second World War, then, no majo 
methodological advances in Survey research had been made for two 
decades. There had been a numerical increase in census-like 
inquiries in various localities, in planning surveys and ina plethora o 
rather worthless community studies. The predominant policy 
interest of this period in housing was reflected in the subject marter 
Great stress had been placed on collecting objective data only, an 
when, in some surveys, leisure, crime, or religious activities were 
considered, they were inquired into by rather barren questions. (The 
other major interwar interest in mental deficiency will be eraru 
in the next section.) The questionnaire had become the standar: 
measuring instrument and the skills of social observation were not 
demanded. (To get a flavour of the change since the early Victori 
era, look back at the schedule for the St George's inquiry on pp. 20-2: 


fifteen of the forty-two items could have been discovered by observa- 
tion.) 


> о be adequately considered by 
the media, the arts, the social << ~ Я ус 
(Наггіѕѕоп 1978: 13). 


Observation 1938). 


At its worst, its publications were like bird-watcher’s notebooks; 
the resulting descripti i 


d activities (see Britain and her Birth Ra 
Mass-Observation 1945, for example), could be dreary in t 
extreme. At its best, as, for example, when it documents the effects 07 
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morale of the Blitz (Harrisson 1978), it produced one of the finest 
Pieces of social research of the period. Its antagonists have criticised, 
nightly, its tendency to be unsystematic and magpie-like in its 
collection of facts. But it did make attempts to generalise these 
observations, and must be treated as an important precursor of that 
Survey method pioneered in the USA by Reiss known as systematic 
Social observation (Reiss 1968 and 1971). It could not in the end 
compete after the war with the many new polling companies that 
came into existence to document public opinion in much drier (and 
more questionable) fashion. 


The Second World War and Beyond 
ar has stimulated the need for social research on many occasions. 
Empires needed to be able to count those available for military 
oo Britain's earliest imperial ventures in the West Indies and 
ater in the Boer War were the occasions for some very careful studies 
Of the health of the troops. The First World War demanded research 
Into the physical conditions of those who were expected to fight and 
to Work in the crucial munitions industry. But the Second World War 
Involved the civilian population in a hitherto unknown manner. 
Food and clothing had to be rationed, and there was widespread fear 
that civilian morale would collapse under the pressure of aerial 
bombardment. For these reasons, government survey activity 

Increased markedly during the war. 

| In 1940 the Wartime Social Survey was founded by the Home 
ntelligence Division of the Ministry of Information, with the active 
encouragement of the navy, whose chiefs were very anxious about the 
effect of the Blitz on sailors and their families and on dock-workers 
(Harrison 1978: 297), To start with it was based on a pre-existing 
institution in the Department of Employment, run by academics. 
€n the war began to look desperate in the summer of 1940, and the 
early morale surveys had run into a reaction against "Соорег- 
Soopers’ (Cooper was the then Minister of Information), a young 
researcher from Gallup Poll, Louis Moss, was brought in to re- 
ersanise it. Thereafter it restricted itselfto a variety of surveys on diet, 
1сасу of rationing, knowledge of venereal disease, the effect of 
med of Information publicity campaigns and other more directly 
ual topics (Box and Thomas 1944). e 5 
S5: жн. between the actual work of the British Wartime 
оста! Survey and the activities of the Research Branch of the US 
rmy is instructive. The active involvement of academics was much 
more marked in the USA, because there was à much larger and more 


Ourishing sociological community. Respected figures like Stouffer, 
erton, Lazarsfeld, Likert and Guttman were all associated with the 
у in the USA was not so 


Project. The reaction to morale surveys ! 
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touchy either; they were mainly confined to surveys within e 
forces, since the civilian population was not being bombed. ls 
major differences come in the use that was made of the irap tea 
Britain, the data was not only not offered to academics to a ext 
independently, but it was actually covered by the Official Secre Mh of 
and not released to anyone. The reflective perusal of the wea Pes 
wartime material that was such a tremendous spur to Am dier 
sociology and which led to the publication of The American ју 
(Stouffer 1949, Merton and Lazarsfeld 1950) and а spate of scho 
works thereafter, had no counterpart in Britain. ; T" 
Some description ofthe postwar growth of the survey industry dà 
been given in the Introduction. Atthe end ofthe war, sociology a 
very productive period, flourishing at the LSE and tie toes We 
shall see in the next section. But the two major developments int 5 
fact-gathering aspect of survey research came in the rapid expansio 


of research done by central and local government, and the growth 0 
the market research and opinion polli 


The Wartime Social Survey had p 


When the Office of Populat: 
1970, under the influenc 
Statistical Service.4 

The Social Survey has b 
major methodological areas. 
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encouraged the development of analytical procedures to explain 
these facts. 

The amount and quality of data turned out by the Social Survey is 
quite extraordinary. As well as doing a wide variety of ad hoc surveys 
for almost every government department, it has done major pieces of 
work for Royal Commissions and special inquiries, and it has also a 
Programme of regular data collection. The Family Expenditure 
Survey was started ona regular basis in 1957 and has continued ever 
Since, providing detailed income and expenditure information from 
Which the weights for the Retail Price Index are derived, but with 
other spin-offs too. It has put efforts like Orr’s on to a regular basis, 
and an annual Food Survey is carried out for the Ministry of 
Agriculture and Fisheries. And in 1970 it started a more general 
Survey of housing and social conditions which has provided a wealth 
of high quality data for current and future social researchers. The 
General Household Survey is the nearest thing in the United 
Kingdom to the American National Opinion Research Center's 
General Social Survey; the questions in the GSS, however, are 
Somewhat more attitudinal and are rather more closely researched. 
But the big difference comes in the two organisations' attitudes to 
other users. NORC market this rich data source actively, whereas the 

оста! Survey has not prioritised making the data easily available for 
academics. 

For many of the survey historians, this is the natural end point of 
the story: active governments, committed to welfare and social 
intervention, linking with those who have the technical expertise to 
Provide them with the data they need for their compassionate social 
Programmes. There are, of course, other ways of recounting the 
history of the welfare state (Gough 1979) and previous complacency 
'S getting a rude shock with the advent ofa stridently anti-egalitarian 
d anti-welfare government, which may be expected to bring with it 

n attack on social research. У 
, The other tremendous growth point in the last thirty years has heen 
in what might be loosely termed consumer research. Welfare ie ^ 
‘sm, unwilling or unable to plan production very apum тураа 
aken great strides forward іп planning consumption, not rd o | 5 
goods and services, through market research of various kinds, but also 
of its cultura] products, through readership surveys and a 
research, and of its political products, through both public bs 
Private political opinion polls. This has opened upthe cri + pe e 
Subjective to much wider, rigorous inquiry than ever before. id je 
tions such as Social Trends include more subjective items, = 4 ауе 
Carried a couple of articles on ‘subjective social indicators (Abrams 
1973) which aim to give a kind of consumers verdict on the 
Satisfaction derived from various social goods. The main vehicle for 
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such inquiries has been the survey, anda large number of commercial 
research organisations, some tied to specific companies (like 
Unilever) or specific newspapers (like the Daily Mail’s ownership of 
National Opinion Polls), and some independent ventures have grown 
up over the years. It remains to be seen whether the growth will 
continue into a period of industrial and commercial decline. 

Several methodological innovations have accompanied this 
growth. The commercial companies have pioneered the use of quota 
sampling, which is spurned by statisticians because its error margins 
are not calculable, but which the market researchers have found 


Ini 
one Bee Ров have brought with them methodological change 
i ы development of thinking about the subject 
mad OW at the beginning of the twentieth century. a 
ade from informant to respondent. A further sh! 
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The self-styled ‘survey tradition’ is usually the only history of the survey 
method that is recounted. Histories concentrate on the development of 
the social survey as a way to collect together social facts to settle debates 
about population growth, to expose terrible urban conditions, or help 
administrators make plans of various kinds. The task now is to try to 
give an account ofthe much less well-understood development of some 
kind of inferential reasoning on the basis of the information gathered 
about the causes behind the patterns discovered. This is in part the 
history of the development ofa social science, rather than the develop- 
ment of complex processes for social administration. We must trace 
the development of an understanding, in whatever crude form, that 
one can infer from the way things are something of the cause of their 
being in that state and that one can on that basis begin to erect explana- 
tions overand above descriptions. 
А Now, clearly the line between description and explanation is hard 
о draw for several reasons, and it is especially dangerous to start 
equating explanation with science and description with non-science. 
As biologists will tell you, many years of careful biological activity 
went into the pre-Darwinian classification of species into different 
groups; perhaps, some may argue, sociology has been forced to have 
an extended period in its Linnaean phase. Explanation and 
escription interact. The major conclusion from much of the recent 
activity in the philosophy of social science is that there can be no 
theory-free observation language for recording facts in an entirely 
Deutral way, The very certain categories we use for collecting the 
Original data predispose us to answering particular types of questions. 
here are three things that are required for the development of 
causal thinking in surveys; (1) The theories the scientist is working 
with must themselves be expressed in valid causal terms. (2) The 
Original data collection and measurement must be adequate to 
Produce worthwhile data; the categorisation must be sensitive 
enough to pick up important variation, and it must try to avoid 
circularity in setting categories up which prove only one point of 
view and do not even allow the test of alternatives. (3) Some technical 
аррага( 5 has to be to hand to measure association between variables 
4nd to allow controls to be placed on some intercorrelated variables. 


Epidemiological Intuitions aboutCause ||. uu 
. ven Опе reads the early surveys and statistical investigations ofthe 
Dloneers, it is very hard to appreciate how little they had worked out 


cir views of causality on a systematic basis. Indeed, in the first 


volume of the Journal of the Statistical Society of London in 1838, itis 
Carefully explained that The Science of Statistics differs from Political 
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Economy, because, although it has the same end in view, it does not 
discuss causes, nor reason upon probable effects; it seeks only to 
collect, arrange and compare ... facts' (Editorial 1838). One can 
often find intuitive causal logic being applied, but it is never made 
explicit, so the insights ofa few geniuses get lost. The early construction 
of life tables with age-specific mortality rates could represent the 
germ of an idea of imposing logical controls in order to make valid 
conclusions about causes of death, but it is very easy to overinterpret 
the gains ofthe seventeenth-century demographers in this area. 


century, in the inquiries into the 
s of the working class and the army, 
€ sophisticated view of causality. À 


ја ve ofall is the tireless work of the head of the 

Е of the General Register Office, William Farr. 
underlyin Oni by Chadwick's notion that there must be 006 
£ cause of death and disease, and this allowed him tO 
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‘social physics’ and who helped organise the census in Belgium in 
1826. He started collecting and publishing averages and rates of 
things like crime, and he noticed that the empirical distribution 
looked rather like the error distributions that French astronomers 
were discovering, and began to see if normal and binomial distribu- 
tions could be fitted to these empirical distributions. Although we 
would not nowadays accept that the regularities in these distributions 
have the status of ‘laws’, nor that there was any quintessential 
‘homme moyen’ or social average type, this was a significant 
advance. Moreover, Quetelet was quite happy to contemplate 
multiple causality, and constructed multivariate tables, breaking 
down crime rates by age and sex. Many see his contribution as pivotal 
to the development of quantitative social science. Indeed, Lazarsfeld 
reckons he really grasped that observations across a cross-section of 
people could replace observations over time (Lazarsfeld 1961). у 

But although many people were working with de facto theories of 
causation, no one had tried to make explicit the method of recognis- 
ing a cause. The problem is still with us and continues to stimulate 
hot philosophical debate. John Stuart Mill, in his System of Logic, 
had put forward hypostatised conditions under which one might 
recognise a cause, but had no suggestions about how to achieve them. 
His canon of concomitant variation only gave guidance in the case of 
perfect relationships and simple causality. This and other mistaken 
Notions about causality held many early sociologists back. Durkheim 
in particular was very influential in authoritatively documenting his 
confusions in a set of Rules which others then attempted to follow 
(Selvin 1965). Durkheim was not alone in believing that each out- 
come, event, or effect could have only one cause. The notion that 
there might be several inputs into an outcome, or that variables might 
be related to one another in a probabilistic rather than in a 
deterministic fashion, was very slow to develop. Indeed, in a classic 
methodology text of the late 1960s, the authors still find it necessary, 
in a chapter entitled ‘Some Mistakes about Causality’, to spell these 
misconceptions out and show how they have misled a wide number of 
different criminological researchers (Hirschi and Selvin 1973). 

The other two requirements for the development of causal survey 
analysis were a good classification system and the techniques for 
Measuring association and partial association. Durkheim is 
responsible for another confusion in the requirements of a classifica- 
tion system, in his demand for ‘aetiological’ rather than ‘morpho- 
logical’ classification systems. He insisted that you should classify 
suicides into different types according to different causes, rather than 
according to different superficial appearances. He suggested there 
were three (or four) basic causes of suicide – egoism, altruism, anomie 
(and sometimes fatalism). But if you make such sweeping 
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assumptions in your very classification system, how are you ever 
going to show independently that your causal hypothesis is valid? 
You constantly run the risk of circular reasoning. The only 
independent evidence that Durkheim could try to adduce for his 
scheme was that he had ruled everything else out — a rather dangerous 
line ofargument, for you can never be sure that the things you did rule 
out constitute the universe of possible rival explanations. 

None the less, and despite Durkheim's best efforts to subvert the 
enterprise, the ideas of independent classification systems which 
could be justified on outside criteria, and the apparatus of measuring 
association and the logic of multiple causality did develop. And at 
this point of the story, the three prerequisites come together for à 
powerful period in the eugenics movement, where a concern with 
measuring one particular thing, namely IQ, was being developed 


alongside a particular theory of causation and control, namely 
regression theory. 


Eugenics, Regression Theory and Mental Testing 
Fear of the lowest strata of society, the mob, criminals, lunatics all 
barely distinguished, was, as we have seen, a characteristic of muc 
nineteenth-century research. Booth had shaded this element in wit 
black on his maps of London, and considered a policy of forcibly 
removing this sector to labour camps (Jones 1971: 306-7). The lin 
between poverty and other forms of distress and low intelligence Of 
“feeble-mindedness’ was a tenet of faith for many of the middle class 
investigators long before they had any means of measuring IQ. Th's 
lumpen element was poisoning the ‘respectable’ working class. The 
eugenicists carried this belief through to a political programme 9 
Social Darwinism, which aimed to restrict the breeding of thos¢ 
whose stock of mental attributes was inferior, : 
It is under something of a cloud today. Disgusted by the racial 
doctrines of Nazism, of Aryan supremacy and purity of stock. many 
have searched for the intellectual antecedents of such a repugnant 
philosophy and, finding the nearest thing in Britain being the 
eugenics movement, have in turn been repulsed by that. But it ie 
mistake to call the eugenicists early fascists (Searle 1979). They yere 
not; they were a particular brand of middle class intellectuals, many 
of whom considered themselves socialist, at least in an anti-/ai5567 
faire sense of the word. Eu : ide a very 


nse genics happened to prov! 
convenient ideology for the newly mobile; the idea that innate mental 


qualities are unevenly distributed and are found predominantly 
among the children of those who were successful in the previous 
generation was undoubtedly appealing to them (Mackenzie 1979). 
Galton and Pearson, the two pioneers of both the eugenics move 
ment and the early apparatus of correlation and regression, bot 
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passionately believed that social qualities were largely inherited, and 
they wanted measures of inheritability and coefficients of correlation 
between parents and children. Galton, himself one of a most 
distinguished family, was driven by no abstract interest in 
mathematics, but by a desire more concretely to apply his cousin, 
Darwin’s, ideas of natural selection to humans; building on ideas of 
the positive effect of mutation and random selection, he was keen to 
see how the two distributions of characteristics of fathers and sons 
might be related, and thus worked out the fundamentals of the theory 
of regression, which hypothesised a process generating human 
characteristics in this fashion. Pearson, a founder member of the 
Eugenics Society, elaborated this into a mathematical system and 
derived formulae where Galton had only managed to express his 
ideas graphically. Thus he equipped the eugenics movement with the 
technical apparatus for fulfilling its proclaimed socialistic intentions 
of a complete meritocracy where only the able would be allowed to 
reproduce. 

_ The techniques for measuring intelligence directly had not been 
invented at this time. The work of Binet in France was under way, but 
the great spur came when Spearman introduced factor analysis to the 
Statistical community. He was a disciple of Galton's, and was also 
convinced of the inherited qualities of intelligence. He thought that 
this assumption was corroborated by the fact that there was always 
one general factor which resulted from the reduction of items in an 
intelligence test by a method of extracting principal components 
(Sharpe 1978). He must also get credit for elaborating an important 
set ofideas about the kinds oferrors one could expect in measurement 
and how to assess them, ideas which have been part of the psycholo- 
gist’s stock in trade for years, but which have still not adequately 
penetrated sociological thinking. 
_ These advances in regression theory received a very powerful boost 
in the hands of the brilliant statistician R. A. Fisher. Working at the 
Rothamsted experimental plant station in the 1920s and 1930s, he 
generalised ideas of analysis of variance, and began to argue for 
improved techniques of experimental design based on the principle 
of random allocation. His books, Statistical Methods, published in 
1925, and The Design of Experiments, first published in 1935, gave 
his supporters the texts they needed as a basis for a distinctive new 
discipline of mathematical statistics, which was very remote from the 
activities of the social surveyors. We find it very hard to remember 
nowadays quite how new and revolutionary these ideas were (see Box 
1978, Ch. 6 for an account of the impact of The Design of 
Experiments). The practical outcome was that experiments could 
now be designed which genuinely fulfilled Mill's canons and held 
everything constant but for one factor; the way this was achieved was 
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through the simple device of creating a control and experimental 
group through random allocation. The excitement about this 
innovation was so great that interest in ‘natural experiments’ suffered 
an eclipse, certainly among statisticians of the Pearson ilk. 

The dominant interests of Galton, Pearson and Fisher were in 
attributes which could be measured on an interval scale, and since 
they assumed that the process generating these attributes was 
inheritance with random mutation, posited that the error distribu- 
tions for all these qualities must be normal. Interest in counted data 
was temporarily suspended. This delayed the development of the 
apparatus of association in survey data which was more often than 
not collected in a form which permitted numbers in a category to be 
counted and little more. The prevailing measure of association was 
Pearson’s, based on the assumption of underlying multivariate 
normality. The only tabular information that this can be applied 
to isa 2 x2 table, where again you have to make the assumption that 
the cutting points are arbitrary divisions made on top of an under- 
lying normal distribution. One must assume, for example, that the 
division of cases into those where a drug worked and those where it 
did not, is an arbitrary line drawn down the middle of an underlying 
spectrum of successfulness. This denies some very important 
‘natural’ divisions, such as the difference between none and some, ог 
between natural integers like number of children. But it fitted in well 
with a theory of regression. 

There was no shortage of other ideas, but these simply did not gain 
ground. Retracing our steps a bit, we find George Udny Yule, in 
many ways the real founding father of survey analysis, battling with 
Pearson at the beginning of the century about how to measure 
association in a contingency table; he rejected the assumptions on 
which Pearson's measure for 2 x 2 tables was based, and proposed à 
measure of his own that did not rely on underlying multivariate 
normality (MacKenzie 1979). Moreover, he understood the logic of 
controlling variables in non-experimental situations where the 
variation had occurred naturally, without randomisation and 
manipulation. In the Introduction to the Theory of Statistics, first 
published in 1911, he insisted that multiple causality was a reality; 
and that controls must be introduced. He introduced his own 
measure of association for contingency tables, Q. By the fifth edition 
in 1919 the chi-squared distribution was included. By the seventh 
edition in 1924 the simple notion of crosstabulating, of laying the 
aggregated numbers out in rows and columns, was introduced. 

But these quite simple ideas were neglected in other statistics 
textbooks which dealt solely with Pearsonian ideas, and in social 
survey texts which never mention anything other than sampling 
theory, and occasionally percentages as a descriptive tool. Once 
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again, we are faced with a problem of understanding why these ideas, 
once elaborated, did not spread. Selvin has even shown that 
ignorance cannot be the explanation, because Yule engaged in debate 
with Booth about the presentation and interpretation of his data, and 
itis also likely that Durkheim had read periodicals in which Yule was 
writing (Selvin 1976). Once again, the unsatisfactory explanation 
that there was a failure to institutionalise is put forward. More 
plausible is the view that enthusiasm for methods based on the 
analysis of variance were more exciting froma mathematical point of 
view, and provided grist to a political mill of eugenics. Moreover, as 
we saw in the last section, the kinds of surveys done in the crucial 
interwar years were not very exciting and did not attract the attention 
of the best statisticians to them. 

So the apparatus for tables with more than two rows or columns 
was not developed; analogous measures to partial correlations and 
Interactions in analysis of variance were not elaborated. Yule’s 
discovery of the importance of the cross-product ratio in many 
different measures in contingency tables was not discussed again until 
1935 when a paper appeared in the Journal of the Royal Statistical 
Society on interactions in tables (Bartlett 1935), and then nothing 
further developed until well after the war. Great excitement about 
experiments dominated the field, and led to a concentration on 
measures of significance rather than on measures of association; the 
reason for this is that when you have manipulated the variance, the 
marginals do not contain any new information, and so significance 
tests and the analysis of variance are much more important. All the 
technical developments for elaborating statistical models for con- 
tingency data were there for the asking by 1919, but it took until after 
the Second World War for Lazarsfeld to elaborate the logic and for 
Goodman to develop the concepts and models for handling 
contingency data. d + E 

The social and political climate of eugenics did not just give rise to 
this technical apparatus, however. It also stimulated research that 
certainly asked causal questions, attempting to give a sound 
empirical basis to its central tenets. Previous studies had failed to 
separate social class and intelligence in their basic classification 
Schemes; take, for example, the study in Sheffield in 1919, which 
attempted to classify people as follows: ‘Class 1 includes those who 
are more or less free from the prison of the flesh ... the educated. 
Class 3 are positive failures . . . these are the rotters, the wastrels, the 
Yahoos. From their loins come the intellectually feeble’ (St 
Phillips Settlement 1919). It is not hard to see why the proponents of 
IQ testing were so convinced of the class independence of their 
measures when they replaced these sorts ofclassification systems! 

The other group that had an interest in IQ and influences on 
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mental attainment were educationalists, propounders of meritocratic 
philosophy and local authorities providing education. They felt it 
was important for them to know what the stock of mental capacities 
was, and how open to environmental influence (that is, education) it 
was. The London County Council took the unprecedented step of 
appointing a psychologist, Cyril Burt, to look into some of these 
questions (Sutherland and Sharp 1980). (He is in disgrace today, since 
it has been discovered that he faked some of his data; see Beloff 1980.) 
He conducted many investigations into the determinants of IQ, the 
correlation between IQ and social class, the inheritability of IQ, its 
influence on income, the causes of ‘feeble-mindedness’, and so on. 
His are the most famous studies, but the concern of administrators in 
this period of population decline also showed in other studies. 
Godfrey Thompson in Edinburgh was doing very similar work and 
the Merseyside survey did a special sample ofthose who were socially 
inadequate in a variety of ways, for example. 


The Logic of Survey Analysis 

By far the biggest contribution to thinking about the use of survey 
data to answer sociological questions, which are of their essence 
causal, was given by the quite extraordinarily original and prolific 
writings of one man, Paul Lazarsfeld. An Austrian social democrat, 
trained as a mathematician but, because of his political interests, 
soon concerned by the problems produced by the collapse of 
Austrian society in the 1930s, he worked with the Buhlers in Vienna 
at their new Psychological Institute, and led the team of investigators 
who documented the social disintegration of a village, Marienthal, 
where virtually everyone had been made unemployed. Before he left 
Austria, he had become convinced of the urgent need to bring 
together the insights of sociography with the rigour of more 
systematic investigations. In an autobiographical reflection (Lazars- 
feld 1969) he says that the desire to weld the qualitative and the 
quantitative, introspectionism and behaviourism, intensive an 
extensive methods, subjective and objective stemmed from him alone 
– they were his ‘personal equations’ with which he could not interest 
anyone else. 

When he first went to the USA on a Rockefeller fellowship he 
gained a quick reputation by pointing out that the disturbing negative 
correlation between unemployment and education would disappear 
if you controlled for age; the older you are the less education you are 
likely to have had and the more likely you аге to be unemploye 
(1969: 294). Being Jewish, he decided not to return to Austria after 
the Dolfuss coup, and became опе of the intellectual émigrés who 50 
enriched postwar American academic life. He threw himself into 
establishing a research organisation and became director of a large 
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Rockefeller project on radio research. He found that the new market 
research industry could provide funds for many projects which had 
potentially important spin-offs in advancing basic understanding of 
the cultural determinants of choice; when the US psychological 
profession proved unprepared to dirty its hands with this, he moved 
more into the orbit of US sociology, and during the war his Office of 
Radio Research changed into the Bureau of Applied Social Research 
at Columbia. 

A whole literature on the importance of the ‘managerial scholar’ in 
social research has grown up wishing to treat Lazarsfeld as the 
paradigm to be copied (or to be bemoaned - C. W. Mills's (1959) 
attack on abstracted empiricism and his arrogant remarks about 
intellectual administrators directing research technicians was a direct 
parry against his fellow sociologist at Columbia and his Bureau). His 
combination of ferocious intellect, mathematical ability, political 
sensitivity and organisational drive turned the Bureau into one of 
the most successful research institutes ever. But the literature 
wrongly regarded this success as the norm, and wondered repeatedly 
why there was such a ‘failure’ to consolidate and institutionalise in 
this way elsewhere whereas in fact the Bureau is the exception requir- 
ing explanation. Indeed, since Lazarsfeld's death in 1976 the Bureau 
has virtually collapsed, and the verdict of its biographer is that, in the 
end, not even Lazarsfeld could institutionalise social research in a 
way that was not dependent on the person involved (Barton 1979). 

Intellectually, Lazarsfeld's contributions have ranged farand wide, 
but his most significant one was in developing the approach known 
as 'survey analysis. The early papers on this new approach to 
elaborating complex paths of causality in contingency data (Kendall 
and Lazarsfeld 1950; Lazarsfeld 1955) are not worth reading as 
introductory texts; other writers since have elucidated them and 
taken the basic ideas further (Hyman 1955; Rosenberg 1968; Hirschi 
and Selvin 1973; Davis 1971). But they represent an entirely original 
approach to the problem of elucidating cause from the evidence of 
association. : 

Other statisticians also became interested in contingency tables as 
the results analysis began to pepper the intellectual scene, and Leo 
Goodman formalised ways of fitting models to such causal structures. 
It is always an advance when it is possible to hypothesise models for 
how distributions were generated and then to measure how well the 
model fits the data. The application of this development to sociology 
is too early to assess, however; there are still arguments about the 
interpretation of these models. Many sociologists still feel happier 
with the research style of elaboration, starting with an interesting 
correlation and then unplugging it in different ways (Oldman 1973). 

American sociologists, especially those connected with the 


46 THE SURVEY METHOD 


Bureau, soon took advantage ofthe explanatory power of these tech- 
niques and many postwar classics of American sociology depend on 
it. It has never really caught on in British sociology. Perhaps it is 
seen as a foreign cultural product; the differences between US and 
UK sociology must not be underemphasised. In the 1950s and early 
1960s there was a burst of activity arising from the programme of 
research at the London School of Economics, headed by David Glass, 
around issues of social stratification, education and social mobility. 
Researchers attached to Glass's team included Floud, Kelsall and 
Tropp, all of whom went on to do important surveys, Floud 
collaborating with Halsey and Martin at the LSE to produce Socia 
Class and Educational Opportunity, Kelsall studying the recruit- 
ment, status and organisation of higher civil servants, and Tropp 
developing theories of professionalism by studying schoolteachers. 
Another important institutional locus of good survey work in the 
late 1950s and early 1960s was Simey’s department at the University 
of Liverpool, where interest was more directed to occupation? 
rather than class theory. Scott, the Bankses, Gittus, Woodward an 
Mumford were all associated with the department and some very ric 
studies emanated from this group - The Dock Worker, Coal an 
Conflict, The Computer and the Clerk, to name but a few. What gave 
rise to this burst of activity after the war is quite complex. Liverpoo 
and the LSE had both become firmly established before the war, an 
SO Were in a position to respond to the postwar interest in socla 
Stratification. And the personality of David Glass was probably very 


important in encouraging this work, although the position of Simey 
in this respect is less im 


failed to create inheritors 


theoretical and empirical activity today. Goldthorpe and Halsey 


continued with some impressive work based on Nuffield College. 
Blackburn and 


01 | ge. They both demonstrate that the 
are British sociologists who ar i tative 


rced to conclude that this fifteen years orano 
Ove away from the traditions of Su 


research and British Sociology well established in the rest O the 


twentieth century. 


Conclusion 
There is always a dan 


А р ot 
ger of presenting a history as a ‘how We £ 
from there to here' acc 


: d- 
ount. It is wrong to view the present as an en 


HISTORY OF THE USE OF SURVEYS IN SOCIOLOGICAL RESEARCH 47 


point, for there are some extremely exciting and important 
developments taking place in statistics. The technological base of 
survey research is being revolutionised by advances in computing, 
both in the rapid extension of hardware which, when linked to 
telephone interviewing, reduces costs dramatically, and in the 
development of more sophisticated software which can handle 
complex data structures. John Tukey and Frederick Mosteller are 
giving classical hypothesis-testing and the theory of probability a 
good shake, and the results (Tukey 1977; Mosteller and Tukey 1977) 
will be very important for survey analysis. There is a resurgence of 
interest in the problems of question-wording, and the measurement 
of the subjective. There is no question of developments stopping. 

Survey researchers should take a keener interest in the history of 
their method than they have done in the past. They should appreciate 
that the ‘survey tradition’ of fact-finding is not their only intellectual 
heritage. They should realise that the fixed-format questionnaire 
survey does not and has not in the past exhausted the range of possi- 
bilities for data collection. The survey method can be, and has been, 
put to a wide variety of different ends; perhaps the most important 
thing we have to gain from scrutinising our past is an understanding 
that a particular method does not restrict you to a particular object of 
research or institutional or political position. 


Notes: Chapter 2 


1 There is a dispute about which should be given prime credit for the intellectual 
developments; they worked closely together, and it is suspected that things 
supposedly written by Petty were in fact penned by Graunt. 5 

2 Thisisnota chance metaphor; his later work was entitled The Political Anatomy of 
Treland. 


3 The commitment in principle to a quinquennial survey had been on the statute- 


book since the beginning of the century. It was finally activated in 1966, but the 
1976 census did not take place for absurd financial reasons. It has been estimated 
m that the census would have cost within two 


that local authorities had spent the sum tha | 
years doing surveys like the ones described in the 1930s for their own purposes. 


4 The personal influence of Harold Wilson, Premier at the time but also a statistician 
who had worked with Beveridge, is reputed to have been important. 


3 


The Critics of Surveys 


In Search ofa Science of Society 

In the background all the way through the last chapter there lurked 
the spectre ofa social science. It was, perhaps, much easier to see how 
various efforts were not scientific than to understand what it would 
involve if they were. The aim of this chapter is to briefly review the 
major critics of surveys. The most influential of the critics have 
argued that the mistake made by survey researchers is in their very 
attempt to be scientific, and at the end of this chapter I shall try to 
shed some light on the reasons for the popularity of the anti-scientific 
position. But others have argued that they are insufficiently scientific, 
and of course at the heart of this dispute there is a disagreement about 
what any science should be. Sociologists who criticise surveys have 
often lumped very disparate criticisms together under the eclectic 
banner ofanti-positivism. 


Anti-positivism Я 
The criticism that surveys are positivist seems to have grown 1n 
Popularity as the funds for surveys have declined. While it would take 
a bold, if not foolhardy, person to argue any too direct a connection 
between these two trends, none the less the coincidence is 100 
convenient to pass without comment. Surveys are indeed very costly 
things. And a good quality Survey may cost two to three times a5 
much as an inferior version of the same thing, as anyone who has ha 
experience tendering jobs to commercial companies will know 
(Marsh 1976). Companies offering good fieldwork services have 4 
precarious existence, and badly need the protection of assured fund- 
ing from some non-profit-making body. If it could be shown that 
something as costly as this was fundamentally flawed in its 
conception, how much money could be saved! ; 
The idea of surveys being inherently tarnished through thelT 
inevitable positivism has gained sway. This section will examine this 
claim. But first it will be necessary to examine the nature of the claim, 
and to consider the growth in Popularity of the use of this term 
‘positivist’, whose meteoric rise to fame is even more startling. 1 
fully document how this has happened would take an intellectua 
historian of unusual acumen, for I do not believe that the story woul 
contain much reference to the printed word. It seems to be part ofthe 
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conscience collective of sociologists which only rarely surfaces to 
print. It seems particularly prevalent among our students who 
constantly amaze me by their mouthing of the incantation of the 
positivist nature of survey research within two days of the start of 
their sociology course, before they have read any Durkheim or even 
heard of Auguste Comte. It has become a term of abuse first and fore- 
most, a synonym for crassness in sociological parlance. 

It is very hard to define what exactly is meant by the term, for it is, 
with the exception of Comte’s writings, almost never a self-applied 
label. Kolakowski (1972) defines positivism as a philosophy which 
says nothing about the origin of knowledge, but which aims to 
provide a demarcation between the knowledge that deserves the 
name science and that which does not. He extracts from the wide 
range of philosophical schools to which the term might apply four 
main elements which sum up its essence: 


(i) the rule of phenomenalism, which asserts that there is only 

experience and which rules out all abstractions be they of matter 
or spirit; x 

(ii) the rule of nominalism, which asserts that words, generalisa- 
tions, or abstractions are linguistic phenomena, and do not give 

.. usnew insight into the world; 

(iii) the separation of fact and value; 

(iv) the unity of the scientific method. 

Much of the scorn against positivism is in fact an attack on the idea 
ofa social science, but it is important that we be clear that these rules 
are inadequate as a basis for any science. The first two amount to 
saying that all knowledge is limited to experience, and that it is 
impossible to go beyond this to some deeper reality; they amount to 
the rules of empiricism. While historically the development of these 
postulates about knowledge served a useful purpose in refuting forms 
of theological idealism, they deny the possibility of cognitive 
knowledge. Their adoption would deny the search for underlying 
personality or social structures with dynamics which affect the 
world of observables but which themselves are not directly open 
to perception. I stress this; positivism is correct in asserting that 
evidential criteria have to be sought in our sense perceptions of the 
world, but is incorrect in asserting that theories flow directly from 
these perceptions. Yet recent developments 1n the philosophy of 
Science have demonstrated that pre-theoretical observation, and a 
pre-theoretical observation language, has never existed, and indeed 
Strongarguments have been adduced to show that it never could. 

The third postulate would make sociology a purely technical 
endeavour, collecting the facts aliis exterendum, to use the motto of 
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the London Statistical Society; let others use the facts to inform their 
value positions while we get on with the job. If this postulate is 
accepted, the only thing that can go wrong with research is that the 
facts might be wrongly perceived or wrongly reported. The notions 
that categories used are inevitably based on theoretical positions is 
denied by the positivist. One can laud attempts to avoid the personal 
faults of bias to be found in social scientists, without hoping to 
achieve a theory-free method of research. 

The final postulate asserts the unity of the scientific method. There 
is no objection to this if we define the scientific method broadly 
enough. Any scientific endeavour presupposes the existence of 
regularities in the world which could be uncovered. It strives to build 
theories which model these regularities. It tries to express the 
theoretical terms precisely and unambiguously, and to show how 
they can be operationalised. It leads to formal propositions and rules 
about what counts as proof and disproof. And it conducts tests of 
those theories in as open and systematic a manner as possible, check- 
ing that the results are generalisable and not specific to a particular 
Investigator, particular place or time, or a particular measuring 
Instrument. 

But it is also true that no one has yet managed to specify precisely 
one method for achieving these laudable goals. It has been tempting 
to take the common methods of the most ‘successful’ sciences, like 
Physics, and declare these to be the methods of science. This has, 
quite naturally, come under attack from social scientists who do not 
find the methods of physics the most useful way to approach their 
data. The methods of research are bound to be different for conscious 
and non-conscious subject matters, especially when it comes to that 
highest form of conscious activity, namely choice, or ‘free will’. The 
‘law of price’ is clearly of a very different nature from the ‘law 0 
gravity’, because it isa result ofa social structure that is itself open tO 
manipulation. For this reason, we must minimally expect the laws 0 
the social world to change much More rapidly than the laws © 
physics. As social scientists, however, we shall often question the 
freedom of that will. Pierre Bourdieu was able to show how choice 0 
marriage partner in a tiny French village led to inevitability 1° 
marriage partners, and yet was still accompanied by the couples 
falling in love – that emotion that feels the free-est of all. He calle 
this ‘amor fati, that love of one’s own social destiny, which, by the 
apparently hazardous and arbitrary paths of free choice, unites 
partners already socially predestined for each other’ (cited in Le ROY 
Ladurie 1980: 186). But this is not to rob the human subject of the 
ability to imagine and intend, of the dignity of refusing to divulge the 
name ofa comrade under torture, of the excitement of falling in love- 

Nor does calling the endeavour ‘science’ say anything about the 
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form of organisation or social location the research should take. We 
have seen in the historical overview how often research was just 
needed as a kind of intelligence service for a ruling class which had 
become separated from the urban poor, conducted by many whose 
desire for research was motivated by high-handed, manipulative and 
otherwise offensive doctrines; their ignorance was the product of the 
social distance between themselves and the objects of their research, 
which, had their subjects been the researchers, would have obviated 
the need for almost all the questions. But can the post-Robbins 
sociologists really see themselves cast in that mould? Do they begin to 
suspect themselves of inculcating bourgeois ideology? Is it a 
collective self-doubt that leads to the current spectacle in Britain of 
the hunt for the positivist ‘other’? 3 

Much sociology still acts to show people to one another, but it 
could be much more profound if conducted by ‘insiders’. There is 
another survey tradition to turn to, that of a social science as a 
collective effort of a group to become conscious of itself and under- 
stand its own dynamics more fully. The earliest manifestations, 
especially in the ‘community self-survey’, restricted the group to 
architects and planners, but Mass-Observation showed that it was 
Possible to involve a wider group. The words ‘social science’ had 
None of the same manipulative reverberations in China in the 
Cultural Revolution when it was used to describe a collective 
activity. If sociologists are worried that social research isan adjunct of 
a centralised and manipulative government which they do not 
sympathise with, perhaps they should criticise the government rather 
than the research methods. Ed 

Positivism is, in fact, like sin: everyone is against it. The question 1s 
whether surveys are inherently sinful. Are they good or bad in them- 
selves? Do you have to buy this unsatisfactory epistemological 
Package to get the free gift of survey methods? To make this 
argument, critics would have to show that either the systematic data 
collection required to produce a case by variable matrix, or the 
process of analysing the relationships in such a matrix, was bound to 
be tarnished by the postulates outlined above. The rest ofthis chapter 
Will consider the most influential criticisms that have been made, first 
of methods of data collection and measurement in surveys, secondly 
of the levels of analysis they use and thirdly of the kinds of explana- 
tion the analysis leads to. It will quickly become apparent that the 
Criticisms fail to add up toa coherent assault. 


Positivist Data Collection and Measurement Р 

The first line of criticism has come from phenomenologists, ethno- 
methodologists and symbolic interactionists, all of whom see 
language and meaning as the central reality of social life, and who 
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make use ofa set of arguments in philosophy that hold that social life is 
not the appropriate subject matter for science; it is created by sub- 
jective beliefs, intentions and desires which cannot a priori be con- 
sidered as causes. It cannot be ‘explained’ but merely ‘understood’. 

Some, influenced by the philosophical writings of Wittgenstein, 
see the reason for the distinctiveness of human activity as arising 
through the use of language. It is through this linguistic capacity that 
people create the societies they live in and give their actions meaning. 
Human action is not governed by laws, but is, rather, constituted 
through the rules of language, and any regularities which we find in 
human behaviour reflect these common rules rather than any con- 
straining laws (Winch 1958). Rules of course can be broken, whereas 
it is. assumed that laws cannot. Intentions cannot properly be 
considered as causes because they are an integral, logical part of the 
outcome, not separate events. 

The argument is that all human action is the result of this conscious 
activity, that people are choosing to follow these linguistic rules and 
that there is a one-to-one relationship between intentions and out- 
comes. These are all questionable propositions when one probes 
them. The idea ofa rule, and the equivalence between rule-governe 
and meaningful, are rather muddled. Taking a stroll can be meaning- 
ful without there being a correct way of doing it, as opposed to an 
Incorrect way (MacIntyre 1967). There have been some very power- 
ful demonstrations in social psychology that there are determinants 
of individual behaviour which are utterly unknown to the actor. 
Moreover, even where there is a large component of ‘intention’, it 15 
impossible to show that intentions always lead to the intended out- 
come (Davidson 1963). The minute you acknowledge the obvious 
truth that one intention can lead to more than one outcome, or that 
one outcome can be the result of more than one intention, then the 
relationship between the two is no longer simply logical – it is uP for 
empirical investigation. In any given piece of behaviour, we are 
justified in asking whether or not the intention imputed to the actor 1n 
it was indeed the cause ofthe behaviour. A particular intention is not 
entailedby a particular action. 

It is very important that we retain our perspective on other 
languages and other cultures, and continue to ask causal questions 
about social activities. We must not confuse moral and logica 
relativism (Lukes 1977), and argue that because it is wrong to vieW 
one culture as morally superior to another, it is equally wrong to Say 
that all explanations of the world, from science to magic, have equa 
status (Gellner 1974). The importance of language in human activity 
is not denied, but it does not make causal explanation impossible. We 
can and must go on to probe the extent to which stated intentions OF 
unconscious desires did or did not produce certain outcomes. 
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But, a second argument runs, the trouble is that identifying causes 
and identifying desires requires two very different types of evidence; 
the former type will be external and behavioural, whereas the latter 
type is bound to be internal and subjective. The only way we can get 
at the subjective is trying to shed as many of our own preconceptions 
as possible and to emphasise with the actor’s inner life; this type of 
data collection exercise is radically different from the collection of 
extensive, behavioural data. The trouble with this argument is that it 
quickly become solipsistic: how is the subjective experience of 
another to be known? If there is no other way to explain the activities 
of bread roundsmen than by becoming one, why not just leave the 
sociology to the bread roundsmen? One could try to take up the life- 
style of a particular group whose actions one was trying to under- 
stand, but there is no reason why the insights that this gave you when 
you became a member of that group should be communicable to 
anyone else. These arguments have been specifically addressed to survey 
research, claiming that it is incapable of approaching the meaningful 
aspects of social action. In Chapter 5 we shall look constructively at 
Precisely how surveys set about achieving that difficult task, but we 
shall not address some of the general criticisms head on. They have 
centred around the measurement of social phenomena and their con- 
version into variables; they have insisted that the interview 1s а social 
interaction as much as any other, and is open to all the interpersonal 
effects that are found elsewhere in social life. у А 

Survey research uses the language of variables. A variable is a 
parameter which has one and only one value for each case, and which 
varies across the population. Numbers are usually assigned to the 
categories in the process of coding, but these categories need 
represent nothing more than a nominal level of measurement. (It is 


interesting to note that this use of number to differentiate is probably 


its original function; see Struik 1956.) In other words, all that the 


translation into variable language requires 15 that when we code 
something, we must minimally be able to distinguish between a 
characteristic being present and being absent, which is not really an 
Overstringent requirement. Coding something as a variable 
‘measured’ at a nominal level is doing no more than describing it, 
making the rules for the description as explicit, Systematic and 
comprehensive as possible. The possibility of making one of the 
codes ‘inapplicable’ means that all the cases can be described on one 
Coding system. 
_ There are three prominent critics 
in different ways with measuremen 
Blumerand Phillips. 

у Cicourel, in the first chapter 0 
gives an extremely stringent set о 


who have concerned themselves 
t problems in surveys, Cicourel, 


f Method and Measurement (1964), 
f rules for how variables should be 
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constructed. Using the language of measurement derived from 
psychophysics, he argues that scientific models should be explicit 
axiomatic theories where the relations between the variables should 
have a functional form isomorphic to some mathematical system. As 
he quite correctly notes, explicit theories of this precision are never 
found in the social sciences. His criticism is directed against attempts 
to construct a scale with ordinal and interval properties from social 
data; you have to be able to prove that the thing that you are measur- 
ing has the properties that you are trying to measure, rather than just 
assume that it does. He calls this literal measurement as opposed to 
measurement by fiat. He rightly notes that some techniques of scaling 
impose unidimensionality rather than demonstrate its existence, but 
does not acknowledge the fact that there are other techniques which 
aim to test this very assumption. The reason why survey research fails 
to be scientific in his terms is not because his rules are ridiculously 
stringent, of course, but because social life is mediated through shared 
meanings. 

Cicourel seems shocked to discover that social scientists, when 
they develop their scales and variables, are not merely reflecting the 
Properties of social phenomena objectively and literally in ther 
measures, but using a commonsense understanding of the meaning о 
this act or institution for the actors involved. As we shall see in 
Chapter 5, there are several ways to approach these social meanings 
in a reliable fashion in a survey. There are some situations in whic 
one can ask people for their reasons directly. There are some sub- 
Jective variables which can be measured quite successfully. It 15 
possible for outsiders to reliably agree on the meaningfulness O 
events. These solutions all call for careful and painstaking piloting, 
but Cicourel seems to imagine that the need for piloting proves his 
point that the social researcher cannot assume that the commonsense 
meanings are common to the subjects and the researcher. 

This argument has had a popularity among social scientists that ! 
have never been able to fully comprehend. This book is still the most 
popular book on the reading lists of methodology courses in British 
universities (Marsh 1979); my heart sinks when I try to imagine what 
students make of the rather tortured arguments. It is cited in support 
of the view that surveys have inherent positivistic flaws by those who 
would consider Cicourel’s demand for rigorous measurement of this 
type even more positivistic. His remarks have force when directed te 
some attempts at deriving ordinal or interval scales from social data: 
they also have force with regard to the many surveys that are рег 
formed without adequate pretesting and piloting. Not all suya 
research is ofthis type, but even ifit were, Cicourel would not be ab 
to argue that it has to be that way. One single counter example wou 
be enough to knock his card-house down. 
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Other critics have focused attention on the problem of interpreting 
the very ‘obvious’ variables that survey researchers use. One 
frequently cited critic is the symbolic interactionist, Herbert Blumer. 
In two key articles in the 1950s attacking contemporary views of 
social theory, he argued that until the variables that were being used 
in the theoretical endeavours were what he called ‘generic’ variables, 
nothing interesting would ensue (Blumer 1954 and 1956). Blumer 
held that we should not be trying to correlate observables, but show- 
ing the relationship of one basic attribute of social life to another. He 
Cites as an example the concept of age. When we discover that age is 
related to some attitude, we need to know, not that age was defined as 
theanswerto the question *How old were you on your last birthday?’, 
but rather whether the important thing about this correlation is the 
effect of stage in the life-cycle, generation membership, or epoch 
(Berger 1960). Blumer is convinced that survey variables will never 
be able to capture the ‘intimate and inner-moving complex of mean- 
ings’ which underly social processes, but Lazarsfeld or Rosenberg 
would have responded by suggesting either that the complex 
variables should be broken down into their components or that inter- 
vening variables should be introduced to delineate how any 
independent variable is producing its effect. re 

One important derivation of these arguments has been a criticism 
of the use of structured questionnaires. The first thing to say is that 
criticisms of questionnaires alone cannot damn surveys as a whole, 
for questionnaires are not the only systematic method of data 
Collection. Anthropologists have investigated the existence of 
cultural universals by coding features of various societies (Murdock 
1967), Sociologists of the media have made correlations between 
different factors coded from magazines (Funkhouser 1973). There 
have been studies of police behaviour where the unit of analysis was 
the police-citizen interaction and where the method of collecting the 
data was observation, not interview (Reiss 1971). In situations where 
it was not possible to conduct structured interviews, researchers have 
coded the information that they needed afterwards from tape- 
Tecordings of the interviews (Brown _and Harris 1978). So the 
Criticism of surveys that equates them with structured questionnaires 
is just ignorant. (However, if you have ever had to go through even a 
small number of tape-recorded interviews, transcribe them and then 
Code them, you begin to realise why structured questions are so useful 
When they can be justified. This is why that is the most common way 
of collecting data.) ; ; 

But it must be said that structured questionnaires are used too 
readily, and with insufficient thought; many, perhaps a majority, are 
inadequately designed and piloted, and, too often for comfort, are not 
àn appropriate way of collecting the information that was required 
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for the problem at hand. It isa damning reflection on survey research 
as currently practised that no book exists specifically to guide 
researchers through the pretesting and pilot stages ofa survey. 

There are huge difficulties with standardised question-wording, 
but we should note, in passing, the irony of surveys getting blamed for 
the difficulties that arise in asking questions which are sensitive to 
minor changes in wording: surveys have highlighted a problem that 
must exist in any form of data collection which relies upon the 
answers to questions, and it is quite mistaken to assume that anything 
less problematic ensues from more informal ‘negotiated’ interactions 
ina pub overa pint of beer. Many of the subtle meanings in different 
adverbial qualifiers, for example, have only been discovered through 
their use in survey research and through experimenting with different 
forms of wording in a split-ballot (Bartram and Yelding 1973), so 
there is no reason to Suppose that a ‘very’ uttered in a pub is any less 
problematic. 

There is no doubt that ‘bias’ in question-wording has often been 
dealt with in a very simplistic, not to say ‘positivistic’, fashion. It has 
been conceptualised as a deviation from the ‘true value’ which every 
individual has in answer to any question which may be tapped 
accurately or with error (Hansen et al. 1951; Alwin 1978). Payne, in 
an otherwise sensible book on questionnaire design, defines an un- 
biased question as one Which does not itself affect the answer (Payne 
1951). But what is this Supposed to mean? Does it mean that the 
answer would be an utterance that the same person would have made 
Spontaneously? Clearly not, for any utterance is spoken for a reason, 
with the intention of communicating something; spontaneously: 
there 15 no reason why people surveyed should desire to convey this 
information without a reason. The definition is absurd, for we ask 
questions precisely to get utterances slanted in a particular Way: 
Payne continues: ‘one thing has always stumped researchers, and will 


stumped? 

Research into the effects of different forms of question-wording has 
been pitifully meagre, until recently. Now researchers in both Britain 
(Kalton et al. 1978) and in the USA (Schuman and Presser 1981: 
Bradburn and Sudman 1979) are investigating these problems 
systematically. The results of this research do not have to be inter- 
preted as distinguishing ‘true values’ from ‘errors’ but rather can be 
broken down into research on the various ways in which the socia 
context of the interview and the task required of the respondent oi 
an impact on the type of responses that are given. This research w! 
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not enable us to remove these effects, as the ‘true value’ paradigm 
Suggests is its goal, but should improve our understanding of the 
Interview as a process of social interaction and enable us to design 
interviews which achieve higher degrees of communication between 
the interviewer and the respondent. Reactivity isa fact of life in social 
research. We cannot get away from the problems by positing a notion 
of an underlying true value and blaming the respondent to the 
question when she makes a ‘response error’. 

Critics of interviews, however, have frequently gone much further 
than this in their criticism of structured questionnaires. Instead of 
conducting the painstaking research required to pin these problems 
down, some critics have instead proposed that we abandon this 
attempt to get at the social world, and indeed ‘abandon method’. The 
development of the ideas in two books by Derek Phillips is a good 
case in point of this kind of thinking. In his earlier book, Knowledge 
from What? (1971), Phillips reviews some of the problems that have 
been shown to exist in communication in interviews. He reminds us 
that attributes of the interviewer can have their effect on responses 
given to this interviewer (although he is somewhat selective in his 
Teporting of the literature, and does not review the findings of many 
Who have concluded that interviewer characteristics are not an 
important source of difficulty in interviewing). Attributes of the 
Subject may lead to problems, especially when the subject tries to 
Please the interviewer, or is apprehensive about the likelihood of an 
evaluation of performance resulting from the responses given in 
interviews, or tends to agree to anything the interviewer Says. Human 
beings need social approval, not just for themselves as people, but 
also for the views that they hold. The physical setting of the research 
can have important effects on responses, claims Phillips (although 
here again his evidence is weak and has not generally been borne out). 
And perhaps most importantly, respondents have expectations of 
What is required of them, and will try to get clues about what it is that 


the interviewer or researcher expects. у А Р 

In this first book, Phillips argues quite plausibly that interviews are 
often used when they are not the most appropriate method of data 
Collection, but he concedes that there are occasions when they are the 
best way of collecting information – when details of past activities, 


Private activities, motives, beliefs, or attitudes are under study (a long 


list!) is standardised, amenable to statistical 
Me Lua one n riangulated with other methods 


treatment and be generalised. Ift i 
they have their ws. But by the time he wrote Abandoning Method 
1974), a curious cocktail of Kuhn, Winch, Wittgenstein and Feyer- 
abend was having an effect on him, and he concludes that social 
i d of human beings, should stop trying 


Scientists, being no special bree r 
to pretend that they have any peculiar claim to social knowledge, and 
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should rely on the method of introspection, and try to look at the 

world ‘through their own eyes’ rather than through the scientific 
instruments which are currently clouding their vision. In effect we are 
back to the ridiculous idea of Payne that it is possible to perceive the 
world without the instruments of perception. 

At least Phillips openly admits that he has changed his mind 
between his first and second books about the possibility of using 
survey methods. There is a much deeper ambiguity in Method and 
Measurement. Cicourel admits in the introduction that he takes a 
rather extreme position on the need for literal measurement in his 
first chapter, and claims that the subsequent chapters show that he 
does not in practice make these stringent demands on the different 
research methods; he is not proposing that ‘sociologists stop all 
further research and measurement until the basic categories of daily 
life have been clarified and their numerical properties ordered 
axiomatically". But, he insists, nor is he arguing that these methods 
could simply be improved. He is rather seeking ‘clarification of socio" 
logical equivalence classes at this level of basic and substantive 
theory’ and he intends to do this by improving ‘the methodologic 
foundations of sociological research’ (1964: 3). 

_ To judge whether he achieves these grandiose (and none (00 cleat) 
aims, one turns to his chapter on the use of fixed format question: 
naires. ‘Standardised questions with fixed-choice answers provide 5 
solution to the problem of meaning simply by ignoring it’. declares 
Cicourel; survey researchers treat the meaning of events and situa: 
tions as self-evident’. Some clearly do, but any reader who thinks this 
is true for the entire class of survey researchers should turn now 
Chapter 5 and read the account of the two years George Brow? an 
his team spent designing scales which : s the threat 
associated with ev hich could asses пете 

ents that happened in their subjects’ lives. CICO 
elaborates (1964: 109-11) nine rules which would need to aph 


ang one could treat the results of fixed questions as meaningfully 
valid. 


(1) Every response would have to be expli 1 
xpl ally. 

(2) Pretests would have to have been me theoretically 

(3) The social researcher would have to know the situation 50 well 
that the responses to questionnaire j be rea 
indicators ofa social process, ire items could 

(4) Question and response would have to use familiar language the 
meaning of which was not to be altered by context. 

(5) Clock time must agree with actor’s experience of time. 

(6) Meanings of questions would have to be understood identically: 


(7) Researchers need a theory of meaning to show how (4) and (6) 
have been achieved. 
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(8) The forced nature of the questions would have to be removed. 

(9) It is not just enough to say that the words must be understand- 
able but the meanings which respondents have must be 
translated to the social scientist’s language by means ofinvariant 
correspondences. 


There are two themes underlining these rules. The first is perfectly 
acceptable, namely, that all the small decisions about coding and 
grouping that are made in the course of the research should (a) be 
recorded and (b) be defended according to some theoretical rationale. 
E the extent that Cicourel can be read as arguing for a much greater 

IScussion of these points of detail, his contribution could be very 
Positive. But his insistence that the questions should be understood 
identically and not open to different interpretation according to 
‘particular relevance structures’ is much more problematic. He is not 
Just asking for unambiguous questions; every textbook that has ever 

сеп written on questionnaire design suggests that this is a good aim. 
When treating peope’s beliefs and attitudes, there is a very thin line 
dividing the meaning people endow social objects with and their feel- 
ings about them. When you ask people their attitudes to the EEC, 
they are not all really responding to the same stimulus, because they 
all have different associations with this object. The researcher will be 
«een to discover precisely how views of the EEC vary according to 
Particular relevance structures’, if I understand the term correctly. 

nd one interesting method of eliciting the assumptions respondents 
make about events and institutions is to probe precisely what they 
mean by and associate with particular stimuli. Stressing the need for 
Invariant meanings capable of being coded by explicit literal rules of 
Correspondence is effectively saying that this type of research is 
Simply impossible, until indeed the basic categories of daily life have 
s clarified and their numerical properties ordered axiomatically, 

atever he sa 1 inp. й 

Structured Se are not the only way of collecting 
Systematic information from a cross-section of cases, but they 
Constitute a very popular way of doing so. They always run into 

ifficulties with unanticipated definitions and responses, ag Сге 
Points out, so, to succeed, they rely on very careful piloting (for a 
painstaking example from the National Readership Survey, see 


A i у oly on the problems of 
son 1968). Neither do they have a monoP iy ples oe 


Meaningfulness of social action. They have P ; 
Whic i | h than they have been given 
h require more thought and ыан, in defence of the case that 


to date, В : 1 : 5 ; 
. But discussions like this are cite : 

the problems are insurmountable. Certainly. Cicourel sae о. 
X: Show how it could be done, or to elaborate a theory о! me g 


Which could achieve his fourth and sixth rules. 
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The Atomist Fallacy 

Another way that surveys might be shown to be inherently positivist 
would be to prove that they committed one to a particular level of 
analysis. You would be forgiven for thinking that the fallacy histori- 
cally associated with positivism through the writings of Durkheim and 
Comte was that of holism, of assuming that there was anything real 
about properties of whole groups of societies independent of 
properties of members of those collectivities. But the majority of 
critics have levelled the charge of atomism: 


Their fundamental source of information is a sample of 
individuals. The questions asked in these studies are put in terms 0 
the psychological reactions of individuals. Accordingly, the 
assumption is required that the historical structure of society, in 50, 
far as it is to be studied in this Way, сап be understood by means 0 
such data about individuals. (Mills 1959: 79) 


This charge that surveys are fundamentally incapable of perceiving 
structural effects has reverberated through many ofthe criticisms. 

But it simply will not hold water. To be sure, it is a danger, 45 the 
best Survey practitioners have recognised: ‘Quantification, 50 
important in providing evidence in support of generalizations, 
often produced an artificial atomism of the organized socl@ 
Structures under investigation’ (Blau 1957: 58). But it is corrigible. 
First, ifthere is to be only one level of analysis, the unit does not have 
to be the individual, as we have seen. It could be the household. the 
firm, a society, village, or even units of time. The danger involved 1? 
only looking at collectivities is dealt with in the traditional criticisms 
made against holism: it reifies social Processes, and suggests that there 
is something real and tangible about social forces independent 0 
individual actions. But these criticisms can be met by designing У 
study so that the measurements are made at the appropriate leve of 
analysis, and the effects of processes at one level on outcomes at 
another can be empirically tested, 

There are a wide variety of ways in which variables can be related 
to one another at different levels and lead to a hierarchical dataset: | 
is very important that researchers specify how they hypothesise their 
relationships take effect. If, in a random cross-section of workers 
drawn from many different workplaces, we found a negative correla- 
tion between shift-working and class-consciousness, it coul 
because 


(1) working shifts makes individuals less likely to develop clas?" 
consciousness regardless of what other people in their factor? 
do; 
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(2) people on shift work come from factories where shift work is 
done; under these conditions the whole factory fails to develop 
class-consciousness, shift-workers and day workers alike; 

(3) shift work is more common in particular industries which for 
some historical reasons unrelated to shift work directly have had 
anon-militant tradition. 


In other words, it could be an individual effect, a contextual effect, or 
a global effect, or a combination of these (Lazarsfeld and Menzel 
1961). On a simple cross-section we could not pin down which. 
There is no need for ad hoc rationalisations made after the event to 
explain why the negative correlation resulted. Such arguments can be 
very dangerous, as Hauser has shown (1970). But if the competing 
explanations can be anticipated, with some careful thought a study 
Could be designed of several factories and workers within those 
factories to illuminate some of these interesting questions. 

The sociology of organisations has pioneered the collection of data 
on how individuals relate to other individuals, the creation of various 
aggregate indices and the comparison of group effects with individual 
effects held constant. Blau stressed as long ago as 1957 that features of 
the group of organisation as a whole, aspects of its Gestalt, could also 

€ brought into the picture alongside aggregated features of the 
collectivity, and many industrial sociologists have taken up these 
methods. 

But hierarchical data structure is not the only answer to the charge 
of atomism. We can also collect data on individuals and their 
relationships with other individuals. In studies of diffusion of new 
Information among doctors, Coleman, Katz and Menzel set out to 
discover the views of doctors’ friends, as well as the doctors them- 
Selves, through a technique known as “snowball sampling (Coleman 
et al. 1957). They picked a random start, and then got each doctor 
they interviewed to tell them the names of his closest аат 
Coleman (1959) has summarised the various sampling and po 
Strategies open to the researcher who wishes to avoid the pitfalls o 
ee l tus for handling the 

t must be poi t the statistical apparatu 

analysis of Le ge H ee underdeveloped; the problems of 
sampling inference and degrees of freedom are very conp p» 
Furthermore, the only user-friendly computer software uer ^ n 
Survey analysis at the moment requires that the data be rec x T А 
that is, а straightforward case by variable matrix, to be proce к ud 
Ooking for relationships between variables, not beigen cases. is 
ave a survey that has information stored hierarchical у, а n 
this into rectangular data matrices can be tedious, А СИА. gui : 
exist on how to do this (Sonquist and Dunkelberg 1977). We can loo 
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forward to the next generation of software which will make available 
to ‘naive users’ the advantages of more sophisticated methods of 
handling hierarchical and relational data. When we can move from 
individual to household to village or from worker to factory with 
great ease, then perhaps this potentially exciting way of handling data 
will become more popular. There are gains to be made from studying 
institutions rather than having to infer their effects from individual 
data. This is why, forall its faults, Fifieen Thousand Hours, a study of 
twelve London secondary schools and the children in them, is such a 
tremendous step forward in the endless debate on the effects that the 
education system has on children (Rutter et al. 1979). 


Attack on Positivism from the Rationalists NS 
Another way to make the charge that surveys are inherently positivist 
would be to argue that drawing causal inferences from patterns in 
data suffered from one of the flaws associated with Kolakowski's four 
rules mentioned earlier. Ifone did not recognise the role of theory an 
assumptions in drawing inferences from correlations, then that 
practice could potentially commit these mistakes, but again, it does 
not intrinsically. Indeed, it is the positivist who, because © 
empiricism inherent in the first two postulates of positivism, cannot 
accept that the aim of science is to uncover the causal relationships 
between things. Ideas of cause and mechanism, indeed the very 19 
of necessity, is an abstraction erected by theory. It is the positivist 
who must deny the difference between correlation and causation- 
The empiricist Karl Pearson spelt this out very clearly in n 
Grammar of Science (1892). 

None the less, it is on attempts at causal explanation in surveys that 
a group of anti-positivists whom I shall characterise as ‘rationalists 
have focused their attack. If Iam to be guided by a survey of texts mos 
frequently mentioned in British social science courses in selecting 
representatives (Marsh 1979), I would pick Hindess’s Use of Offic!4 
Statistics in Sociology (1973), and the work of David and Judith 
Willer. Since the publication of E. P. Thompson’s withering attac 
on the Althusserian rationalism of Hindess and Hirst (Thompson 
1979), readers may be referred to that. The fact that Hindess 4065 
claim that ће is making suggestions about how empirical researc 
should be done should not conceal the basically anti-empirical stance 
ofhis philosophy. 

So the Willers will have to do the honours. The two texts for con- 
sideration are one by David Willer published in 1967 entitle 
Scientific Sociology and one by both David and Judith Willer 
published in 1974 called Systematic Empiricism. Both books 
ostensibly claim to hold that a science of society is possible; they 
argue that it will not be achieved by the current use of ‘systematic 
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empiricism’ : 
три will only be accomplished by а rationalist theory- 
Wee е Both books claim that this rational science will 
not through empirical evidence, but will do it through abstraction, 
е пат A SERS avons through logically produced categories, 
ing а y or operationally defined variables, by provid- 
imer ais a unlimited in scope of applicability to particular 
decimos rad rather than by providing historically specific 
unlike any Be ata wonder this science will be to behold - and quite 
іе itu er science! When this conception is examined more 
E rdum out to bea fake. It is no accident that the first book, 
morean Hei a to be a description of what a Scientific Sociology is, is 
how аа it is not. And the second gives not one clue of 
to be approached. piricism is to be avoided if the empirical world is 
eh get painted ofa social science. in Scientific Sociology is 
Пена ја Мене is the familiar denunciation of survey research as 
Palen ar panes that it inevitably treats individuals. There 
should ME ee on random sampling, proposing instead that we 
about a finit m ‘scope sampling „aiming not to make generalisations 
üniversal vena of individual cases, but to establish *conditional 
truth! (In f s' about human affairs. Return oh ye gods of absolute 
act, all they really require 15 disproportional stratified 


can b pean ЕТЕ 
properly tested in widely differing circumstances.) 
m is its opening state- 


ith ‘empiricist’. After 
slope into historical 
's contribution to the 
factually inaccurate), high- 
ys and techniques 
he contributions of Pearson, Fisher, 
Blalock, often in a 
Hindess 1977 for similar 


Saca aim to debunk traditional research practices, the criticisms 
arfume in fact proposed are very traditional and well known. Their 
they еп! against experiments boils down to the old chestnut that 
the As e come up with valid empirical generalisations because of 
"st tade-off between naturalness.and control. (Field experiments are 
tient entioned.) The arguments against scaling assess its achieve- 
order by the traditional criteria of dimensionality, stability and 
eH And surveys are held to be an example of systematic 
Piricism because they cannot demonstrate causality. 
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Yet it is not clear why they should consider this last point to be a 
criticism, since they believe that the very terminology of causation is 
further evidence on the mistakes of systematic empiricism. They 
believe that science is not a set of statements about natural regulari- 
ties; indeed, it does not even need to presuppose that there are any, 
according to the Willers. Scientific laws are definitional, analytic and 
man-made, and so any notion of cause in theories which claim to be a 
statement about necessity in the outside world is incorrect. They 
assert that theories aim to make ‘determinative statements’ which 
predict outcomes universally across time and space; how they think 
theories can do this without some notion of a world that is caused, 
however, is beyond me. 

The view of science that is put forward is utterly implausible. 
"Science. . . ignores what is and what was, often denying observation 
in order to generate theoretical postulates.' There is a very weak 
clarion call to radical sociologists to get out ofthe conservative way O 
thinking of systematic empiricism, and liberate themselves from the 
tawdry world of reality. ‘Science assumes no empirical truths, an 
thus is not restricted by them.’ How very much easier it would be (0 
do sociology (or be a radical!) ifone could sit back on this assumption 
When the only truth is truth by definition, and when science has по 
empirical content, but is rather a logical structure, relating to the 
empirical world by abstraction, there is indeed no need for a concePt 
of cause. It is highly significant that both this strongly rationalist 
account of science „апа the Althusserian version propagated | 
Hindess and Hirst is driven to arguing that causes do not eu 
Extreme empiricists have been driven to the same conclusion. T 
reason for this coming together is that it is only the language of caus" 


which unites logical and natural necessity; empiricists deny the 
former and rationalists the latter. 


Criticisms of Survey Methods of Causal Inference 5 
Ironically, the criticism that comes nearest to the mark in sustaining @ 
charge of positivism comes from those who have not questione 
value of the canons of science. They have doubted the ability of the 
survey on the fourth ofthe five rules of scientific procedure, пате ^ 
in its ability to test propositions in a systematic way. They point to 
the inherent weakness in drawing causal inferences from a correla- 
tion with controls established post factum as opposed 10 € 
experiment which sets up controls through randomisation (Stouffe 
1949; Madge 1953; Hauser 1969). 
It is true that some methods proposed to draw inferences from 
correlational data have been frankly positivist. Fisher believed tha 
his tests of significance would provide some kind of automatic 
theory-generating process that did not require judgement or the inter 
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vention of the scientist. This eccentric view caused a rupture with 
Pearson in the end, who believed that to reject a null hypothesis was 
ipso facto to accept an alternative hypothesis of some kind. There are 
a wide number of data-dredging techniques in the multivariate 
armoury which will search your data for pattern for you, from step- 
wise regression to AID (automatic interaction detection). The 
existence of cheap computing, which gave such a spur to the develop- 
ment of causal modelling technology, can be badly misused: you can 
crosstabulate ALL against ALL as easily in SPSS as you can do 
something more thoughtful, and then you can select those interesting 
tables (that is, those with a significance level of less than 0:05) to 
reconstruct a story for. With any luck there will be about one in 
twenty of them! (Selvin and Stuart 1966). 

The fact that these blatant misuses of survey data are possible does 
not mean that they are inevitable. The techniques of elaboration, to 
be discussed in the next chapter, can be used by those who have 
theories about the way the world works which they want to test, and 
who are not prepared to restrict their constructs to apparent 
observables. Such researchers do not derive their theories in any 
automatic way from the data, but rather use the data as a test, albeit a 
limited one, of a theory they have already formulated. The theory 
dictates which variables to introduce into the analysis, and to that 
extent such endeavours are not positivist. But we have already noted 
the problems with any passive observation programme: you never 

now that you've brought in all the right variables. There is no way of 
undermining this objection. The Lazarsfeld/Rosenberg techniques 
plow how to introduce test factors to see if the relationship one is 
looking at holds up under different situations. But the sample size 
dictates limits to the number of variables one can control, and there 
may be a host of variables that one has not suspected (or thought 
about too late!) whose impact is not tested. The precise nature and 

irection of the causal relation has to be assumed, for it cannot be 


tested, | 
orld, in order to know it, 


cannot be improved on. As Mao said, if you want to know the taste of 
а Pear, you must eat it. Or, as Kurt Lewin said, if 


© drank scotch h 
and soda, vermout 4 
and concluded that the problem was the soda (Kish 1959). ea 
Ti Would have realised his mistakes when he just cut ou : 
jeu practitioner might not! 
le he objection cannot be underm | 
ast for the time being. For, until the Utopia © 


ined, but it can be overridden, at 
f community social 
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science is on the agenda, the range of phenomena open to experi- 
mentation is lamentably restricted, on both practical and ethical 
grounds. Far from being the cadillacs of research design (Acland 
1979), in reality experiments are driven into laboratories where their 
subject matter is constrained and their realism is questionable. 

On the other hand, it might be (and has been) argued that if the 
researcher cannot practically or ethically intervene in the social 
world she wishes to study, inferences should be drawn from the 
attempts of the politicians or administrators to so intervene. When а 
policy change is made in one area, what consequences flow? The 
attempt to investigate this kind of question has been termed a "аџаз!- 
experiment’ (Campbell and Stanley 1963), and the activity. of 
evaluating the social world as it changes is known as ‘action 
research’ (Halsey 1972). 

This style of research seems to differ from both classical 
experiments and from surveys, and this seems to contradict my 
earlier remarks about these two methods exhausting the logical 
Possibilities of methods of drawing causal inferences. Can 'quasi- 
experiments’ not meet both the objections to laboratory experiments 
and the drawbacks to inferences from surveys? The answer, alas, 15 
that they are more likely to run into the drawbacks of both and the 
advantages of neither. They do not represent a ‘middle ground’ in 4 
continuum between experiments and surveys. The power of the 
experiment as a tool of research lies in the creation of a genuinely 
comparable control group through randomisation. The 'quasi-' bit © 
the term comes from the fact that control is never adequately 
achieved. Moreover, since the assessment of the effects is so often 
dependent on one case, and since the practical difficulties of measu 
ing all the other factors at the time Which might have produced th 


effect, from the passage of time per se to the Hawthorne effect. аге 59 
great, the result is oft i 


The attack on Science | 

Inferring processes of causation from patterns in the final outcome 15 
a dangerous business. It is here that surveys run most risk of being 
positivist, but this is not taken up in that debate. This is because the 
emotional centre of anti-positivism is rejection of the values oi 
science. Science is held to be a cloak for unwarranted, ideologica 
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claims, and a new term, ‘scientistic’, has been coined to convey the 
Sense that these claims do not have the validity claimed for them. 
Critics of this kind cannot berate surveys for not being like experi- 
ments, because if surveys are ‘scientistic’, experiments are worse. 
This is ironic because, in one sense, experiments have a truly radical 
potential: they can create variance which had not previously existed, 
whereas surveys are much more restricted. 

The line between science and scientism has got very blurred in 
these debates. There is a great deal of unease among sociologists 
about using the former term to describe their activities, almost as if 
there was something embarrassingly naive in believing oneself to be 
engaged in a scientific pursuit. The good old idea that knowledge 
itself (science comes from 'scientia' – Latin for knowledge) is neutral, 
and can be put to good or bad ends, used or abused, has suffered a 
temporary eclipse (Griffiths et al. 1979). The ‘New Left’ position is 
that the knowledge that can produce such barbaric technology as the 
nuclear bombs which destroyed Hiroshima and Nagasaki, or the 
defoliants which denuded North Vietnam, is not just being misused, 
but must be fundamentally evil in itself. It was hard to argue that the 
knowledge could be used differently when supposedly socialist 
Countries were using it in the same way to build bombs. In fact, this 
Position represents a new form of technological determinism; the 
argument boils down to the idea of there being something fundamen- 
tally wrong in the technology. : А 

The ‘use-abuse’ model was hard to extirpate in the natural 


Sciences, but it has been given up freely by social scientists, especially 
hat they were doing 


by the ‘radicals’ and the New Left. It was not t [ 
Tesearch which was being put to grossly immoral ends. They did not 
disagree with the reforms which were 50 connected with social 
Tesearch, although many doubted the value of reformism’ as a 
Political programme. Their objection was, that the term ‘social 
Scientist’ appeared to allow some human beings, mostly an élite in 
Universities (a numerical élite anyway in British universities to which 
Only 6 per cent of the relevant cohorts go), to claim superior know- 


lëdge abo ie eople marry who they do and so 
ut such basic issues as why реор knowledge's sake in the 


Оп. Могеоу і nowledge for | 
Social a ed idea ate much fee, and the 1960s generation of 
Social scientists owed little allegiance to the ruling authorities. 
€ can now begin to discern that the 1960s and 1970s New Left 
Phenomenon was partly a reaction to the seeming truth that capital- 
ism had solved its recurrent problems.of crisis. You could no eis 
criticise capitalism for failing to produce the goods; postwar socia 
€mocracy clearly was providing health and education, as well as a 
Wide range of consumer goods. Instead you had to criticise the goods. 
Part of the student movement of the late 1960s and early 1970s was 
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talking about sociology teaching in universities being the inculcation 
of bourgeois ideology (Blackburn 1972). But now the continuous flow 
of goods seems as though it might be drying up, as health and welfare 
service are cut, manufacturing industry slumps and sociology depart- 
ments are closed. Once more, the old idea that the relations of 
production might actually be a fetter on the means of production 1s 
beginning to re-emerge. It seems as though current capitalism cannot 
in fact utilise the science and technology that the 1960s generation 
criticised as inherently bourgeois and ideological. 

In Chapter 6 we shall examine the various ways in which survey 
research is put to manipulative uses; we shall find it necessary to dis- 
tinguish between the abuse of genuinely powerful survey techniques 
and the undoubtedly scientistic claims of opinion polling. But We 
have found no way to make the charge that surveys are inherently 
positivist stick. We have tried looking at it from a wide variety of 
angles, and find that the arguments will not come together. Most 0 
the texts considered have been American, although there do exist 
British examples (see Pawson 1978, for example); they have, how- 
ever, had a far wider impact in Britain than they have had in the 
United States. Speculating on the cause for the popularity of the 
accusation of positivism, one is forced to look beyond sociology А 
wider cultural values. Buta stronger refutation of the anti-positivist 5 
Position would be to find some examples of surveys which W! 
illustrate some of these points, and it is to this that we now turn. 


4 


Adequacy at the Level of Cause 


This chapter and the next will examine the extent to which surveys 
can provide explanations of social phenomena which meet Weber’s 
requirement that they should be both causally adequate and adequate 
at the level of meaning. In reviewing the different criticisms of survey 
methodology in the last chapter, it was pointed out that the process of 
drawing causal inferences from surveys is problematic and indirect; 
we know that a correlation does not equal a cause, but we shall see in 
this chapter how far down that road it is possible to push it. 


The Concept of Cause 

here has always been a fierce controversy about the usefulness ofthe 
Very concept of cause in most areas of life in the natural world, in the 
Social world, in the moral world. It has intensified this century 

есаџѕе of developments in physics that seemed to threaten 115 
Mechanical basis. There is not the space, and I have not the 
Competence, to get involved in that debate, but there are 
Some observations that must be made to facilitate the discussion 1n 
the rest ofthe chapter. ; 

(1) It is important to accept (and indeed the language of not just 


everyday discourse but most scientific discourse accepts) that causes 
> really exist out there in the world; ne haye r 

ement of the universe’ (Mackie 1974). They 27. iooi 
e univer ay pus work out what is going 


epistemological concepts designed to hel 


on. 

(2) The central idea ofa causal relationship is that one event, or state, 
ог variable, produces another outcome in the COUTPS of time. When 
We come to study causes, we should be able to specify a starting-point 
to this process, the length of time it takes for the proce to work and 


the end-r ; tter further, we could 
Т8 take the ma > 4 
nlt IE we iod cause, Or We could decide to 


always inquire i f the À ‹ 
investigate in Лотсо of the process to discover how it 
Was that the cause was producing the effect. A satisfactory causal 
explanation will always be relative to the question asked, medical 
Science may be satisfied for a while with the explanation that a 
Particular bacillus is the cause of tuberculosis, but eventually 


someone will want to know where it comes from and how exactly it 
wreaks its havoc. 
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(3) Causation is not the same thing as complete or unque a 
mination. Indeed, the concept of unique determination in а 
world is rather strange to contemplate; the world in wbich it op: й 
would be a strangely metaphysical place. Imagine if all me lunes 
black, working class ... and voted Labour, and all buen 14 
white, middle class ... and voted Conservative. It is dou "Things 
concept of cause would even arise in a world like this. 
would probably just be accepted as being the way they were. . З 

We must be prepared to conceive of multiple causality oa s 
property of the external world, and reject Durkheim's dictum tha 

as one and only one cause. 


different causes are producing different types ofeffects; indeed, it was 
with this idea i i i 


iry. There is no harm, and а lot of good, 
from assuming that we have a situation in which there are many Ways 
to produce a given effect, 
same way Ssary preconditions, other things may 
act as Catalysts, other factors 
effect is Produced, 


hours ruminating on ipe 

, voting some time to ае ist 
thas proved so tempting to fall into an operational! 
argue that causat: 


о 
e Usation amounts to the method as 
at it is defined as constant conjunction in time, 


ume put it, orsome modern equivalent 


: w 
an explanation of ues 
- Experimenters and surv 


ADEQUACY AT THE LEVEL OF CAUSE 71 


researchers alike draw their inferences from observing variation, but 
they. do so in radically different ways. To illustrate this point, 
consider an experiment performed to compare the different per- 
spectives that actors and observers of a social process bring to 
bear; the subject matter of the experiment is also of more than 
incidental interest to us (Jones and Nisbett 1971) The researchers 
experimentally varied the monetary incentive which they offered a 
Series of student-subjects in return for showing a visiting professor 
around the university. The students had been randomly assigned to 
one of three groups, so that the researcher could be confident, within 
limits, that the amount of variability within each of these groups in any 
Characteristic you care to mention was the same, and that there was 
no difference other than chance between the groups. The researchers 
then artificially produced a variation between the groups by offer- 
ing the first group a paltry sum, the second group a moderate amount 
and the third group a lot of money. They then observed the differ- 
ences that this produced in response patterns. and, sure enough, very 
few ofthe low-incentive group agreed, about halfthe moderate group 
agreed and virtually all the high-incentive group agreed. у 

The most striking thing about this experiment is that the subjects, 
when questioned afterwards about their motivation for complying or 
Not, never mentioned money, but instead tended to produce a variety 
of situational explanations – ‘I had nothing to do that afternoon’, for 
example. Another group of students who watched the interactions 
Were asked why they thought the student had or had not complied; 
they did not mention money either, but produced more dispositional 
explanations – ‘she’s a helpful sort of person’. These constant and 
different biases in actors’ and observers’ accounts of behaviour are of 
great interest to social psychologists, but I use this experiment as an 


illustratio $ the point that only the social 
n because it also makes p he full variation in the 


scientist who ha : ket 
s deliberately set out to 5 
Phenomenon under investigation is privy to the true e 
ion. Social scientists do not have to claim to be a special bree 5 
uman beings, ог to have greater powers of insight, to offer 


explanatio i alid than the actors. — ^. 
ns which can be more Y s from variations in the 


, Ihe infe imenter draw à 
effect Menus hei стоеше are direct and watertight. There 
may be differences of interpretation Over precisely how the cause 
Produced the effect, but that something about the experimental treat- 
ment produced the observered differences 15, within the limits ofthe 
aws of probability, certain. How can patterns in a survey produce 
eet causal process operating through time, starting with а cause 
nd endi Б 
и дане“ ot. But just because there is 


The sim A 
: ple answer is that they cann 1 
Nothing in the cross-sectional evidence to clinch a causal argument 
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Ty to com 


in a соп репе able, 
daughter falling in a 


а "Bt 
> It says that the chance of a so 
Whatever the M 


€ 
І Occupational group а 
tional group of their father. Keith t but 
n that perfect Mobility is not a simple ees fits 
à compound (Hope 1981), пе of the elements is a model d en, 
SM Pational distribution to fathers as to childr 

and this is the e 


‘t simply 
base model of mobility analysis because it re 
allows for the fact that some Occupational categories have 
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people in them than others. The second element is a model which 
looks at differences between the origin distribution and the destina- 
tion distribution and tells us how much mobility is required to 
transform the one into the other. This analysis of perfect 
mobility into its elements enables us to quantify structural mobility 
in the same scale of importance as other aspects of mobility, and it 
typically reveals that between a quarter and a half of mobility 
variance’ is due to structural factors. З 

у Зех-гоје stereotyping is another area which needed some clarifica- 
tion of the relevant models before good empirical analysis could be 
Performed. Looking at changing attitudes of American parents to the 
Sex-appropriate behaviour of their children, Duncan (1979) argues, 
you are not so much interested in the changes in the marginal 
Tesponses to individual items (asking whether girls should help to 
Clean the house or boys to wash the car), but in the growth or 
decline of consistent response structures to the questions taken as a 
Whole. When a model is fitted which fits parameters specifically to 
account for ‘traditional’ and ‘egalitarian’ ideologues who answer all 
the questions in this light, much more interesting trends in sex-role 


attitudes are revealed. i 
Models are no more than intellectual crutches, шеа 
Support and encourage theoretical activity of a complex kind. They 


alow us to keep several ideas in the air at once, and examine me 
relationships between them, but their value is lost on many socia 
1 ies ofequations. There 


Scientists when the 3 faseri 
i à y are cast in the form ofa 5 
"S nothing particularly honourable or sacred about algebra; 
Its value lies in allowing us to pursue the purely logical implications 


of relationships betw variables. But since so many people 
including mu EAS had difficulty following the logic 
of vast Systems of symbolic relationships, and often made elementary 
Bical errors in drawing deductions from such systems, when pat 

analysis Popularised the use of the pictorial causal flowgraph 2 
Multiple regression analysis, many people began to see the potentia 
9r using a model as a way of formalising their theoretical activity 


(Duncan 1973). 


Modelli ng Causal Processes by Means of Flows raphs 


S i i means of flowgraphs 
Principles of representing causal models by, conker ae 


are not restricte matics of regression t 

They el cipal ert a and later in this — ни 

illustrate how coefficients can be found for the arrows in such How- 

8raphs from the humble percentage table. In the meantime, 5 us 

explore a little the logic behind these graphs and the ррпор о 974, 

Stine they work. (For a much fuller discussion, see Heise i 
Inchcombe 1968 and Davis 1971 and 1976). 
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The causal model is сеп! 
causality, to the idea that 
contribute to the same effec 
flowgraphs by an arrow ru 


: | А 1 
l „intervening variables in a causa 
Process at a later stag dto collect information about these 


newspaper 
read 


Occupation 


Model 4.4 Causal Model for voting. 
Let us imag; 
the causal inputs аме had ip Do yx der Т У 
Start by looking atallthe thine el ve Mea i т 
omen tend Ote flo oa 


у n 
r ov h OWS as influencing vote. Mena 
Voting patterns; the job ne ently; different age-groups have differen 
Well known that Japoy hat you do influences your party choice –!. 


workers than сопверу П 165 attract more manual and industt 
oe m and the fina] eA Ones. But Propaganda plays ced 
y the Newspapers n ofa pa 


! party is significantly influen 
you read, Whic way you vote will be so™ 
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compound of these four influences, according to this model. 
Moreover, each cause is represented as having an effect indepen- 
dently of other causes; regardless of one's occupation, preferred 
newspaper, or sex, the older you are the more likely you 
are to vote in a particular way. 

The model also suggests that your support for a particular party in 
an election itself has an important influence on the kind of paper you 
Choose to read; the Tory supporter will prefer the Daily Express to 
the Guardian. There is a feedback loop between newspaper reader- 
ship and vote which needs to be taken into account before thinking of 
Vote asa stable end-state phenomenon. There are other influences on 
newspaper readership as well in this model; one's sex and occupation 
influence the type of daily newspaper one reads — a fact which 
editors and advertisers know well. Thus sex affects vote both directly 
and indirectly through occupation and newspaper readership, for the 
га Open to you depend strongly on your sex and when you were 

rn. 

If we can find a way to assign a positive and a negative pole to the 
Variables in the system, then we can include another piece of 
Information in models of this kind, namely, whether variables have 
an enhancing or suppressing effect on later variables. Only age in our 
model suggests an obvious positive-negative dimension, but this can 
= added for the other variables by selecting one category out for 
Teatment. In this model, if we assign female and Conservative 


to the ‘positive’ poles, then we can say that sex has a positive effect on 


Vote. This is quite straightforward to represent with dichotomies, but 


With polytomies the models start to look a little more complicated. 
isa tested readers can pursue this further in Davis 1976, where there 
ап excellent discussion of polytomous percentage tables.) " 
Working models represent pictorially a fundamental point dpa 
fer 'ngs of the world-out-there, namely, that things are bot А А 
bee *ceding events and causes of subsequent ones. Engels mig i 
n writing an introduction to a textbook on multivariate ana ysis 
en he wrote: 


[Wie find that cause and effect are concepti 
as e their application to the individual case as rh 
We consider the individual case in its general connection Wi 
~ Universe as a whole they merge, they dissolve in the concept o 
versal action and reaction in which causes and effects are 


ber аппу changing places, so that what is effect here pt will 
* cause there and then, and vice versa. (Engels 1976:27) 


tiga Now, we have only considered the qualitative 5 
Sted by floweraphs like this — ‘occupation is one caus 


ons which only hold 
such; but as soon 


tatements 
e of vote", 
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or, more realistically expressed in the language of prepaou n=: 
‘being female makes you more likely to vote Conservative А Па Y 
two reasons for wanting to get more quantitative than this. The firs ~ 
to answer questions such as ‘How much more likely are you to you 
Conservative if you are female? and "Which is the ea 
important determinant of vote: sex or occupation?’ (see Bla p 
1961). These are interesting questions, although secondary to b : 
qualitative ones, and are enormously hard to produce technically 
adequate answers to, F 
The second reason is rather more subtle. Although the causal logic 


is individual, we are going to use data from a cross-section of 
individuals to decide if an effe. 


that, if being fe 


to produce a technically acarne 
of the effect — it is utterly dependent on pz 
causal model in telling us which variables 
control. 


Without discussing at this stage any of the technicalities a 
Producing the Coefficients to summarise the causal strength of th! 


allow us to 


H e 
3 ways. н TER in which on 
"есап affect another ys, both direct and indirect, in 

we thi : 


adda fifth aol the variation in voting being unity, then we ee 
have not included in the. model 1.1 the other causes of vote t 


6 е - : or error 
term. This is Nearly sect variously called the residual 


ADEQUACY AT THE LEVEL OF CAUSE 77 


operate randomly, and that no important systematic effect has 
been omitted. 

Social scientists take themselves too seriously in that they often call 
the residual variance ‘chance’, and put a strong construction on what 
this means. Jencks (1973) concludes that fate is the major deter- 
minant of success in the school system in America because the causal 
models do not explain much of the variance. Blackburn and Mann 
(1979) conclude that chance determines people's placement in the 
labour market more decisively than do their skills or personal 
qualities. But this is to give the concept of chance a positive meaning 
It operationally does not have; in fact, it usually is a negative 
reflection of our ignorance the residual tells us that there is a certain 
amount of variance whose origin we have not pinned down with our 
Model. It is always relative to the state of knowledge at the time. 

The small amount of variance explained is not cause for general 
alarm or despondency. It need not lead us in the footsteps of Derek 
Phillips to abandon method.? How much variation in the location of 
leaves which had fallen off a tree would remain unexplained after a 
Survey of these leaves had taken into account the laws of gravity? 
Quite a lot, It might even be held to be a reason for great rejoicing 
among those sociologists who are concerned above all else to insist 
that human beings have free choice; the types of variables that are 
Considered determinants in causal models are not the results of very 
Obvious choice processes — age, sex, religion, and so on. A relation- 
Ship should be described as ‘strong’ or ‘weak’ relative to 

© 5126 of correlations usually found, and conventions need to be laid 

Own about what to regard as a strong correlation. Davis has 
Suggested a set of adjectives that might describe associations (but only 
on Yule's Qs) of various sizes which might be a starting- 
Point (1971: 50; see also McNemar 1946 and Hyman 1955: 191). 
inally, if such а diagram as our putative model of voting were to 
appear In the pages ofa sociology journal, it would almost certainly 
nontain an arrow linking age and sex. This may seem absurd; there is 
hd in which a priori reasoning would lead you to think that there 
55 us be a causal effect of age on sex or vice versa. But since the 
Eo; Iclents are derived from a cross-section of cases, the arrow 
we resents the descriptive statement about a population that 

Отеп tend to live longer than men and so give rise to a correlation 

*'ween age and sex. It is important to remember this fact about a 
Population that we wish to use to derive other coefficients from. I did 
tha, clude the arrow in the hypothetical example. because I wanted 
Я to be considered as representing the ‘true’ effects on voting for 

ny individual. 
si Orany one person, of course, this model would bea hopeless омег- 
™plification of the processes which had been at work in the past and 
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í i hing in 
were still operating to produce a particular vote. а a 
this model which captures important political ан нат 
unique impact of discussions with family and а а о ne 
outlook, and so on. One Justification that mig t pe sen Pec 
model is that it contained all the processes that are co wp tar 
people. (Even then there are howling deficiencies See hin: 
no mention of education, or religion, or trade union m political 
there might be nothing common enough to т ht have 
experiences for a generalisation to be in order, but we We ge d 
includeda variable which summarised the partisan tendencie nig 
individual’s most close daily Contacts.) Our concern for w 


А our 
generalisable to the Population as a whole comes from 
belief that what is general is of s 


that we shall derive the coeffi 

our knowledge ofthe Population asa whole 2 must 
The difficult technical problems of deriving these coefficients 

be kept separate from the si 


er readership. 


e 
when the unit of analysis in the survey (th 
) is the individual: ifa survey had been peron in 
e logic would be about causal tong nii 
a ll sc hools, However, as we noted earlier, even when t = tro- 
analysis is the Individual person, variables can always be € e 
hd effect of various social Or ecological agencies 0 


З iffer in 
ub; in the population but a 
i nal model said, in fact, that age W‘ ur 
са lgin j 1 Я 
but i nem Indirect influence on voting behavio ie 
ет you had taken it into account, you could add a sepa 
amount for the e 2 „У 


hip. 
.0' occupation and Newspaper readers ry, 
les o av that || 15 Dot the case. Throughout this centum 
from class pee allegiance in Britain have been moving 2 

$ z 1gion- и 
erented framework. T based polit 


ssue- 
Ics and towards a mN c 
i pecie CRUCIS i k of young y 
today is Not so muc question to ask o. y non 
- Wheth ; ; nual or 
manual, or if they are Church ta jab they do is ma 


of England or Non-conformist, 
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whether they think that the trade unions have too much or too little 
power, for example. Given that political allegiances crystallise fairly 
young, younger people are more affected by changing currents in 
politics than are their parents, and so we cannot hope to find one 
model which will sum up the effect of job on vote across the whole 
population. 
. Statistically speaking, this means that we suspect that there is an 
Interaction or non-additivity in the system. The operational 
definition of an interaction is a situation in which the relationship 
between two variables depends on the value ofa third. But, pursuing 
the realist's argument, what it asserts is that, underlying this, the 
Processes of causal determination in the external world are not the 
same for all members of the population. Interactions cannot usually 
be represented in flowgraphs. Some multiplicative relationships can 
be coped with by transforming the scale of measurement of the 
Variables, such as a log transformation. But the change of scale that 
might promote additivity in one part of the model might not work in 
the rest, so, in general, the only way to cope with interactions 1s to 
Taw up a separate model for each of the categories of the variable 
that is causing the interaction. Indeed, most analyses of political 
allegiance are forced to give separate accounts of different age cohorts 
and the influences upon them. 

Otice that I have been very careful up to now to express the 
reasoning on the basis of the causal model, and not on the basis of the 
€xistence of correlations in any particular dataset. I argued that ifsex 

oes have a direct effect on vote, then we should find a correlation 
etween sex and vote after controlling for the other variables; I did 
Dot say that if we find such a partial correlation in the data we should 
hereby infer the existence of such an effect. There is no need to be an 
absolute purist in these matters; we can all smile at the folk myth 
among statisticians of a colleague who would only calculate those 
Correlation coefficients that he had decided to investigate before- 
Pus and had posted to himself in a sealed, dated envelope to prove 
«о е world that he had a priori reason to suspect would be 
I&nificant Provided we understand the dangers inherent in ad hoc 
reasoning, we can pursue hunches generated later in the process of 
ata analysis, But the vital thing is to realise that the validity of any 
Particular Coefficient is dependent on the correctness of the causal 
Pine as a whole. If it is mis-specified, then the coefficients that we 
alculate will be absolutely meaningless, however many stars for 


statistical significance they cancommand. | : 

ett € have already stated some of the required properties of the co- 

to cients on the arrows. They must be capable of being multiplied 

ee to produce indirect paths of causal influence and of being 
"med to estimate the total causal effects. If we are prepared to 
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make one further assumption, their calculation will be quite straight- 
forward. Unfortunately, as with most ofthe powerful assumptions of. 
statistics, it’s a big one. We have to rule out reciprocating causal 
Systems. Going back to the hypothetical example of the effects on 
voting, we must rule out the feedback loop between newspaper 
readership and party preference. However plausible such a loop may 
be in reality, if we are not Prepared to say that, at the end of the day, 
the net effect is preponderantly from newspaper to vote rather than 
vice versa, we shall never be able to estimate coefficients for the 
arrows from a cross-section of people. 


The mathematical reason for this is that any sample will only yield 
one coefficient to express the exten 


e multiplicative and additive rules © 

n isolate the loop, and, further that we a 
£n to it, as in Model 4.2. How 

mm Kont the total effect of newspaper on vote? Well, itis the direct 

(0:015) ui an infinite Series of ‘indirect? effects, 0:3 x 02 x Ed 

"settle 00403 x02 x 0:3 x02 x 0-3 (000108), and so on; this will 

Tound 0:319, which is the coefficient we would expect 10 


find expressin 
ee the 
Point in time, 8 the dependence of Vote on newspaper at any one 


Newspaper 


read 


ifferences have t 
Plicative rules 3 n ae 155 required by our additive and multi- 
paths through Z, is Shien ke effect of X on Y, net of any connecting 

y the partial regression coefficient of Y on 
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X controlling for Z; alternatively, it is the average of the differences in 
%Y between X and not-X in both Z and not-Z conditions. Both 
regression coefficients and percentage differences are asymmetric 
measures, that is, they take on different values depending on which 
variable you decide is causal and which caused. The values obtained 
will also depend on which variables it is deemed necessary to control; 
in trying to estimate the direct effect of X on Y, any variables which 
offer an alternative connecting path between X and Y must be 
controlled, but those which do not can be ignored. So, the conclusion 
once again is unmistakable: the value of all the coefficients depends 


utterly on the correctness ofthe model. 


Assigning a Causal Order to the Variables 
How, then, do we decide how to place the variables in a particular 
order? The forlorn search still continues for a way of torturing the 
data into revealing its order to us, but the results, like those of other 
forced confessions, are not very reliable. One such is a technique 
known as ‘instrumental variable estimation’ (Wonnacott and 
Wonnacott 1970). It claims to be able to solve the problem of having 
reciprocal causation in survey data by calculating the value of one of 
the arrows between two reciprocating variables net of the effect the 
Other way round. How does it achieve this miracle, when, as we have 
Noted, surveys only yield one measure of the covariation? It does it by 
making unrealistically strong assumptions. If you wish to calculate 
the effect of Y on Z, you have to find an ‘instrument’ which is a third 


Variable with the following properties: 


e it must have no direct effect itself on Z 
• it affects Y either directly or throug 
affect Z 

neither Y orZ influence it 

e itis uncorrelated with the error term of Z. 


h a variable which does not 


You of course can have no evidence that the variable you choose as 
the candidate has these properties, because of course it will appear to 
€ associated with Z even when controlling for Y. You just have to 
€cide that the appearances are illusory, and your assumptions m 
at is going on are preferable. It is a fascinating piece of statistica 
Teasoning, because if such a variable could be found, then indeed it 
Would solve the problem of causal systems with loops in them, and 
15 would be very convenient. But candidates for such variables c i 
Not thrust themselves forward in the ordinary course of socia 
research, 
tig other obvious way of ordering the v 
"dimension to causality, and to reaso 


ariables is to make use of the 
n that if X occurs before Y, 
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doa 
ter hoc. Unless we 

t be a cause of Y. Post hoc ergo propter ho mot 
ep survey and go back to the same individuals с he 
questions after an appropriate interval, we do not strict y 


i i ecan 
time ordering of the variables ina cross-section, but, of course, wi 
always ask. If you look at an 


on of events. Despite the decades of ^ 

Put in by. experimental Psychologists into understanding ing 
Processes of perception and memory, they are nowhere near be to 
able to formulate decent advice for questionnaire designers on how 
tackle the Problems, тепсе 

urvey researchers Struggle on, building up a body of experien 
about how to ask i , t 

у <: 7" rather than ‘how often do you... 7’) but no 
finding a Way to codify į € experience about it. Moss Tis 
t together a collection of papers on = 
rm the Subject-specificity of existing research, a 
I ychology to help out to any extent. (or 
nifthe Past events arc recalled with total accuracy a- 
Survey is conducted to collect the required PO 
e time of its Occurrence), there are still t 
ks to using ti 


tus, and so on. 


impossible to us 
marital status, 


, 


) За й 
9 order, say, housing conditions а 
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More importantly, to argue post hoc ergo propter hocistocommita 

logical fallacy. The same conscious faculty of human subjects which 
allows them, conveniently for the survey researcher, to recall events 
in the past, means that they have the capacity to anticipate future 
events and take account of them before they happen. Teenage girls 
may have certain expectations of marriage and motherhood which 
influence their choice of subjects and performance at school, for 
example. 
С But if we are prepared to reason in this fallaciou: 
Ingenious way of torturing the data has been devised, | 
cross-lagged correlational analysis’. The claim is that it allows a 
researcher to order two variables, X and Y, if there exist measures of 
each of them at different points in time. The idea is that if X causes Y 
rather than vice versa, the correlation of X, with Y, will be much 
bigger than X, with Y, (see Model 4.3). (You also check to see that the 
simultaneous correlations of X, with Y, and X, with Y, are smaller 
than the first cross-lagged correlation and larger than the second.) But 
all this only works if, besides all the usual assumptions about causal 
Models of this kind, you assume that the measurement interval is the 
same as the causal interval, and further that the fact that the value of 
the variables change between measurements reflects real change in 
the variable, and not just unreliability of measurement. The fact that 
these assumptions are so rarely met explains the lack of enthusiasm 
for this technique in social science. 


s way, another 
sed, known as 


Model 4.3 Cross-lagged correlations, 


\t the curren in fact, re ined techniques 
wledge, 1n , Ы 
t state of our kno l gi Me f tri 


for m ` a 
IT Measuring the timing of variables and V2 - : 
trickery will not replace тев the way in which the yis а 

ne’s variables is accomplished. Theorising could be in the gran 
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i i e 
tradition (arguing about the causal primacy of ларве ee 
rise of capitalism, for example). It could be ао р s (like 
which influences in life tend to Бе stable and unc eir ic pm 
religion of upbringing). Orit could involve reasoning ipiis cam 
independence of various events (as we shall see in the exa x а t 
cussed in detail in the next chapter). (Hyman 1955 still pro, ue 
best discussion of the different reasons employed by sociolog 


: А isled 
late it, you are always open to being mis 
he relevant factors into account. 


The Logic of Survey Analysis 
Whatever type of theo 
found located in the dai | will 
the process of specifying and elaborating a full causal mode 4 
always be done Prior t 


ow 
Sets of the data and seeing in 
miny ot them а given correlation holds (Mosteller and Tukey | А 
е re eee 15 пої really the dangerofthe ‘chance a ae 
Sterility of th in nisimg 
"red up to explain the М mus Dcus: 
The trouble is that Such ad ho, 
contradictory res 


irectl 
ults, Su I c arguments can produce ats 
ikel APPOSe I told you that people who wore 
навие likely to һауе а crash in the fest ice (regardless 
iol. јату), You would Probably reply that one didn't quu 
Sociologists to tell ys Such e €mentary truths: dangerous drivers 5@ 
more need for Seat-belts than Others, and anyone who puts on a seat- 
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belt is lulled into a false sense of security. If I tell you that people who 
wear seat-belts have fewer crashes, this will again be obvious; safety- 
conscious people wear seat-belts more often and drive more safely. So 
a survey into the effects of seat-belt wearing on driving behaviour 
would have to try to anticipate both ofthe ‘obvious’ explanations and 
design questions which would give more weight to the final 
Interpretation put on the results; perhaps this would be done by 
getting an independent measure of safety-consciousness. (See 
Lazarsfeld 1949 for further discussion of ‘obvious’ explanations.) 

It is not unscrupulous to have a good idea, an insight into the 
Possible way in which one variable is having an effect on another, ora 
pang of doubt that a plausible prior variable may be entirely 
responsible for the visible correlation. In fact, such ideas may 
actually be inhibited by rushing at a dataset with one’s head lowered, 
Model polished and gleaming in one’s hand. If you look at the way 
Sociologists actually work, they often ask of a bivariate relationship, 
why is there a correlation here? and work productively by gradually 
elaborating this relationship at the kernel of their model, thinking, 
refining their ideas, rejecting and including variables one atatime. | 

This is not the only way in which they сап work. Some entire 
Projects are built around a rather different question such as what are 
all the causal influences on delinquency? (the question which Hirschi 
and Selvin set out to ask themselves in their excellent book which 
they subsequently renamed Principles of Survey Analysis because It 
made so many methodological points so clearly); another question 
Sometimes asked is, what are all the consequences, throughovt а 
Person’s lifetime, of the education that they have received? s е 
Question which Hyman, Wright and Reed (1975) asked of an 
M erus 65 of US data). f a bivariate relations 
А ver, the ela ion of a bivaria : 3 
tently popular бае a school of survey analysis вене 
around it. Rosenberg (1968) identifies common steps DG 
«0р and elaborating а relationship between two cm hapten ty 
1111 now leave hypothetical examples and conclude ysis of British 

Tacing them through on an example from an ana deg Fen 
elections that has been ably conducted by Butler and Sto 
“Ported in Political Change in Britain ( 1974). 
ee lation which 
Eam The original correlation. The classic original o idered is the 
relat; Voting studies of British elections NAV ~- ction between 
8 ationship between social ‘class’, defined as the distina can 
et and non-manual jobs,‘ and support eae Parties. 
ntieth-century parties, the Conservative for lines of cleavage 


nike man j the majo : 
y other liberal democracies, + 7. 1 
*'ween the parties in Britain has been this one of occupationa 


hip is a suffic- 
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belt is lulled into a false sense of security. If I tell you that people who 
wear seat-belts have fewer crashes, this will again be obvious; safety- 
conscious people wear seat-belts more often and drive more safely. So 
a survey into the effects of seat-belt wearing on driving behaviour 
would have to try to anticipate both of the ‘obvious’ explanations and 
design questions which would give more weight to the final 
interpretation put on the results; perhaps this would be done by 
getting an independent measure of safety-consciousness. (See 
Lazarsfeld 1949 for further discussion of ‘obvious’ explanations.) 

It is not unscrupulous to have a good idea, an insight into the 
Possible way in which one variable is having an effect on another, ora 
pang of doubt that a plausible prior variable may be entirely 
responsible for the visible correlation. In fact, such ideas may 
actually be inhibited by rushing at a dataset with one’s head lowered, 
model polished and gleaming in one’s hand. If you look at the way 
Sociologists actually work, they often ask of a bivariate relationship, 
why is there a correlation here? and work productively by gradually 
elaborating this relationship at the kernel of their model, thinking, 
refining their ideas, rejecting and including variables one ata time. 

This is not the only way in which they can work. Some entire 
Projects are built around a rather different question such as what are 
all the causal influences on delinquency? (the question which Hirschi 
and Selvin set out to ask themselves in their excellent book which 
they subsequently renamed Principles of Survey Analysis because it 
made so many methodological points so clearly); another question 
Sometimes asked is, what are all the consequences, throughout : 
Person's lifetime, of the education that they have received? (the 
question which Hyman, Wright and Reed (1975) asked of an 


enormous body of US data). у A 
j 549MeVET, the а of a bivariate relationship is а suffic- 
tently popular approach for a school of survey analysis to have сан 
around it. Rosenberg (1968) identifies common steps in the ер о 

testing and elaborating a relationship between two variables an i 
sal. 1 now leave hypothetical examples and conclude the eie 
Tacing them through on an example from an ana Ya o kes pt 


elections that has been ably conducted by Butler an 
Teported in Political Change in Britain (1974). 

(I) The original correlation. The classic original sene pas 
most voting studies of British elections have considere is the 
relationship between social ‘class’, defined as the distinction between 
са and non-manual jobs, and support for the ae re 
Wentieth-century parties, the Conservative and Labour Parties. 
keri | ог lines of cleavage 
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i isi ing-point 
culture, rather than religion, race, or region; this is the starting-po 


iouri ieth- 
forany analysis ofthe influences on electoral behaviour in twentie 
century Britain. 


Table 4.1 Class Basis of Party Support in 1963 — Frequencies 


Non-manual | Manual Total 
Conservative 198 199 04 
Labour 60 502 562 
Total 258 701 959 


x cases 
Source: All these tables are based on data in Butler and Stokes 1974. In some 
enlightened guesses have been used to reconstruct base Ns. 


Model4.4 Simple class-vote model. 


The association at the ke 
relationship, 


the first stag 
remember th 
versa, and so 


mel of the model is, then, this class voe 
as shown in Table 4.1. In Order to use these results to to 
€ of our model (as shown in Model 4.4) we hae 
at we are assuming that vote depends on class, not ks 
We should run the percentages within the categories о 
ting the proportions of the non-manual stratum W 
vote Conservative, rather than the 

ual. Table 4.2 shows 
Conservative in thet 
8. (Since the 


Te still 
Conservatives — 0-284 | Some 


t 
"s » WE can use thi i 569 = 
Я Оп Voting, Finally, i hat 0° 
our sample is non-manual, then У, if we remember t 
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this mod 

ele а at Model 4.5. We can now ‘predict’ that the 
middle е ер m this population, with 0:269 
1s correct for959 + 397. Isn't that dU PURUS 


0-284 


Model4.5 Class-vote model with coefficients added. 


e to break the original 
called partial tables) to 
onditions. There are 
many different types 
sible outcomes, SO it 
ly. The following is 


Table 4 
-2 Class Basis of Party Support in 1963 — Percentages 


Non-manual Manual 


Conservati 
Labour ацуе 0:767 0:284 difference (d) =0'483 
T 0:229 0:716 

otal 1:000 1:000 


(N=258 еы 
Source: See Table 4.1 | | 
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: Ра 
Anyone above the age of 6 sod pue: а Ne -—À 
i not being produced by a causa co : 
wi On of storks and the existence of babies, and ени R | 
third factors which, when controlled, would show that t е 
relationship had been spurious. The urban/rural factor is peri 
explanatory factor in the above Correlation; in rural v i 
humans and storks are more fecund. When you control for this 
elationship disappears. 
o ex largest Nonconformist sect in England, was oo. 
among the newly formed industrial working class. It would be а ES 
reasonable to be worried that what appeared to be a class ides is 
vote was in fact a spurious product of the fact that most о "a 
Noncomformists get manual jobs, and most of them also У di 
Labour. (We have been looking at the share of the major parties DT ile 
now, and ignored the smaller third parties; in fact, among the m! 


маб В T : ists аге 
class this is a serious omission, for middle class Nonconformists 
the major source of support for the 


and Stokes show that when 


ship between occupati у ion 

If the test factor is Prior to the relationship under consideration, 
and if, after its introducti : i 
justified in applying t ious’ to the original relationshiP. 
If, after controlling for į i 


Party can be s f 
that the party is identified with, The evidence presented by But > 
and Stokes suggests that it is not Possible to break down vote oe 
Support for constituent issues on which the party is seen to au 
Policies. There are issues on which the British electorate sees 
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erne оиа Conservative and the Labour Party - the 
a ee E arty is seen to be more in favour of the monarchy, less 
dp d of industry, more likely to keep the 
Bete RU : ut any attempt to interpret party support congruence 
Bonon eei uc 5 stand on various issues and the voter's own 
Voting far ese same issues fails at the first hurdle. Moreover, while 
Hisce vete T party is a fairly stable phenomenon, Butler and Stokes 
TOR fron at very few people have consistent views on policy 
bikes d year to year. So it would appear that vote cannot be 
аара. into component Issue support; it 15 not simply an 
азе Аан of views. This is a very important thing to have 
ete about our key variable, and should lead into other 
Bee explain whatit ‘is’ in more detail. 
fti. pies s variables down into their compon 
dcr sos with causal reasoning; it is rather an em 
паун of conceptual analysis to which the survey resea 
attention. 


ent parts should 
pirical con- 
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4 n 
m а variables. Depending on the type of problem being 
Investigated, the next step could be to go one step back and inquire 


m i |; . "E 
ime factors that give rise to the causal variables. It is interest- 
O ask what determines the type of job one takes. Although this 
dStokes's data 


Questi 
M [uei was not the main focus of the study, Butler an 
Us to examine the effect of the regional structure of employ- 


me eae + 

зе on opportunities for different types of jobs. London and the 
anh wj have very many more white collar jobs than does the 
- We can see from Table 4.3 that regional variation in the 


Cupational structure will be one causal influence on the jobs open 
olling for vote 1n 


to indiv; | 
t js Nividuals to take. There was no point in contr 

i odel, because we are arguing that vote comes after the causal 
ld not expect it to have 


Influ : 
т we of region and class, and so we WOU 
uenceon this bit ofthe system. 


Table 
4.3 Proportion of Middle Class within Region 


North South 


Source: See Table 4.1 


But Я а 
ан thing we should consider is that there may be an impact of 
introduce Voting independently of class. In other words, we may 
ce antecedent variables to try to show what gave rise to the 
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first variable, and decide that we should check at the same time that 
this variable was not producing a spurious correlation between the 
two. This distinction between the fourth and second steps of the 
process of elaboration is often blurred in practice. 

Is the correct model (a), (b), or (c) in Model 4.6? Example (a) 
models the case where an antecedent variable is introduced to show 
how the first variable came about, whereas (c) is an example of the 
introduction of a test factor which shows that the original relation- 
ship had been entirely spurious. The situation in (b) suggests that 


there isan element of truth in both (a) and (c), where region is part of 
the explanation of class, and 


| part of the explanation of vote in its own 
right. 


(а) (9) 


sid 


(c) 


Model 4.6 Alternative models for region, class and vote. 


S to be the most plausible model. Table e 
at there is still a strong class relationship in both 


: А „Ви 
there is als a ie erence in the north and 0:47 in the south the 


uild 
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Table 4.4 Proportion Voting Conservative by Class and Region 


North 
Non-manual Manual 
0:74 0:26 d=0°48 


(N= 146) (№=463) 


London апа South-east 
0:80 0:33 d=0°47 
(N=112) (N=238) 
Source: See Table 4.1. 


a Intervening variables. The next step in the process of unravel: 
ite cause-effect process is often to try to pin down exactly how the 
Come is produced by the cause. As we said earlier in this chapter, 
fake is never one definitive answer to this question; we can amar 
mo * a mechanism or a process more deeply, introducing more an 
re refined intervening variables to explain the outcome. Р 
Nolet Important question to ask about the link between elanon 
Vote 15 the extent to which it is mediated through the mS em 
ан Consciousness, ог whether we shall have to prov! e 2 ud 
Voti Ў of explanation, such as the impact of occupational cultur lm 
ine habits, to explain the association. Butler and Stokes aske 
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Y interpret the relationship. 
Ote that in each of these steps, jd mechanics of what eire 
гаці у 1 Same. We apply a test factor to the original relations ip AN 
© original association within categories at aeon her 
15 int Usions we draw from what we find depend es > ing Н 
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"Ship for spuriousness or to interpret its process MO" i 


6) c А 
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then г." опа! relationships. When we controlled for x im e 


disco, ep mined the effect ofclass on vote in the separate 0:48 in the 
North re that the effects were only slightly different rfl raphs 
S ap Ete in the south. The additive assumption of flow-8 the 
elato; P Cable. But this is not always the case: er ee ies 
Within Ship between two variables is conditional upon, А b 
Categories ofa third. This is called an interaction -something 
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first variable, and decide that we should check at the same time that 
this variable was not producing a spurious correlation between the 
two. This distinction between the fourth and second steps of the 
process of elaboration is often blurred in practice. 


Is the correct model (a), (b), or (c) in Model 4.6? Example (а) 
models the case where an antecedent variable is introduced to show 
how the first variable came about, w 


hereas (c) is an example of the 
introduction of a test factor which shows that the original relation- 
ship had been entirely spurious. The situation in (b) suggests that 
there is an element of truth in both (a) and (c), where region is part of 
the explanation ofclass, and part ofthe explanation of vote in its own 
right. 


la) 
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Model 4.6 Alternative models for region, class and vote. 


In fact, (5) proves to be the m i ble 4^ 
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im те on there is still a Strong class relationship in bott 
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build hese coefficients may be applied to m three-variable model t 
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Table4.4 Proportion Voting Conservative by Class and Region 


North 
Non-manual Manual 
0:74 0:26 d=0°48 


(N= 146) (N=463) 


London and South-east 
0:80 0:33 4=0:47 
(М=112) (N=238) 


Source: See Table 4.1. 


(5) Intervening variables. The next step in the process of unravell- 
1ng à cause-effect process is often to try to pin down exactly how the 
e ome is produced by the cause. As we said earlier in this chapter, 
ere is never one definitive answer to this question; we can always 
Probe a mechanism or a process more deeply, introducing more and 
more refined intervening variables to explain the outcome. 
vote 4 important question to ask about the link between asand 
vot 15 the extent to which it is mediated through the img ne 
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not bus Weaker than the original correlation. None m ra 8 
com len рреаг entirely, so this intervening variable 
P'etely interpret the relationship. 


exactly we in each of these steps, the mechanics др d 
pe original rela 
me. We apply a test factor to the orig nan Be 


Stratify the orjo; Да NR 
0 Original association within categories 0! | 
it is clusions we draw from what we find depend entirely on ite s 
relation ue as an intervening or antecedent variable, to a 
'Onship for spuriousness or to interpret its process more Tully. 
(6 | 
the Condit ional relationships. When we controlled for region, and 
disco, amined the effect ofclass on vote in the separate ен 
North oa that the effects were only slightly different = xA 
35 ap cd in the south. The additive assumption 0! "OY x piir 
relation, ‘cable. But this is not always the case: i Ls 
Within 51р between two variables is conditional upon, t Bs un 

у Categories ofa third, This is called an interaction - something 
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i i i xciting 
hat is a headache from a technical point of view but А 
f es the standpoint of substantive sociology. When ER espe p 
ерон вв are revealed on stratification by a third va 


el must 
observing different ds in the sub-tables, a separate causal mod 
be specified for each condition or category. 


i n inter- 
One of the most interesting and important examples of a 
action in British electoral su 


ose generations who spent D 
World War. Since then, the m zi 
ical allegiances not on ec 
le issues. We cannot hope to D 
important political influences 


influences’; in oth 
together simultaneous] 


ion 0 
Luton (1968), or Runci 6) study of how the МОМА ед 
relative deprivation explained why people accepted E 
rarely went beyond bivariate relationships, although imaginat! 
designed and Written up, imes 
But the surveys of the 19705 have not been any better – somet! ns): 
the standard seems to have declined (with some signal exceptio 


man's (196 
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Gallie published a book entitled In Search ofthe New Working Class 
(1978) in which he compares ‘automation and social integration’ 
Within oil enterprises in Britain and France. The analysis consists of 
Presenting each of his items of information - on income, hours 
worked, and so on – singly for each plant that he studied. Roberts et 
al. (1977), in a survey of two areas in Liverpool in which they 
investigated perceptions of class, do their analysis by correlating a 
Series of different attitudes with a series of different ‘objective’ back- 
ground factors, each taken on its own, and conclude that there is a 
Fragmentary Class Structure (or should it really be fragmentary 
survey analysis?). Newby's Deferential Worker (1977) totally relies 
On single or bivariate relationships. Every table in Blackburn am 
Beynon’s Perceptions of Work (1972) shows various perceptions o 
work broken down by the type of shift worked. I do not cite these 
studies because they are particularly weak; on the contrary» they have 
all had a significant impact on British sociology. They are just 
representative ofa genre of survey analysis. Part of the problem ses 
to be that surveys are still being conducted with inadequate „а и 
Sizes, sometimes as а result of a one-person effort, rather nt bee 
any larger institution to do the fieldwork; the result is that Pi 
Simply not enough cases to build up systems of conjoint influenc 

€ way Rosenberg suggests. . is i 

P to now, third rabies have been brought into the amasi x 

Order to highlight features of the original two-variable eds i ausal 
interest, to check it was not spurious, to elucidate how t pr x 
effect Occurs, to show precisely what it was about the ape 
Variable that produced the causal effect, and to iow ter several 

e original variable. But we have already nOUc S ice if it is 
Occasions that one may also introduce a third variable on ме 
another independent variable operating on the Saas ‘same table 
Ing back to Table 4.4, you will remem er that voting. THE 
Yielded information about the effect of region itself on as the model 
js del that looked like the most plausible fit to P ed 
anga ch region and class both affected vote n ae 

other, and where region had ап effect on class. 4 show the relative 
ing, Able 4.4 be incorporated into this model an 


Vence ofall the variables? c 


Model4.7 Conjoint influences on voting. 
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л joint influences upon 
hows the full model of the conjoi bem 
Eos Maced in of path b will be some — то d PE 
O48 to worry 
: 1 they аге so close we do not nee ‹ = 
е of sverige them Бла proper p ied бе aee 
i "475. Similarly, гап 
instead we can call the result 0 h 0:065 іва redsonable approxima: 
her information we have won 
hich can predict the proportio 


P(Conservative)- c. P(South)a+P(Middle) b 
So: P(Conservative) = 0-26 4 0.365 х0:065 40:269 x 0:475 
=0:412 


ofthe mark, 
Finally, we still need 


class; when we 


ion O 
- The difference in the proportion 
55 people between the north and London is 0-08. 
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Now, looking at Model 4.8, we can make the comparison between 
the two different ways in which region has an effect on vote. Directly 
it makes a 0:065 difference, but it also makes a direct difference of 

‘08 on class, which in turn makes a 0°475 difference on vote; 
multiplying these two paths together, we can say that the indirect 
effect is 0-038 — not a large amount. Furthermore, we can add these 
two effects together and obtain a total effect of region on vote of 0:103; 
thisis approximately what we should have found if we had started out 
with the simple two-variable relationship of region by vote. 


0-26 


0-065 


0:365 


[aes 0475 
class 


0-269 


region 


Model4.8 Filling іп the coefficients for Model 4.1. 


Ta " 
ble 4.5 Proportion Voting Conservative by Region 


London and 
South-east North 
0:374 0:483 


(N 2350) (N=609) 
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103. This model, complete with coc 
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religion 


lise perception veta 
of class 


region 


Model4.9 Further specification of the class-vote relationship. 


ато оппа used in British social research to be exhaustive of 
logical choice "Either. would be faced with a ridiculous methodo- 
the analysis con i ts of s in the surveys that I cited in the last section, 
one other variable sof showing every single variable broken down БУ 
variables sine (usually the same one). Or one processes all one’s 
programme whi red through a computer-based package 

П 11 Will spew forth unstandardised and standardised 


Tm » each with i о 
Significance and number of stars E Standard rng, eve! 


of : 800d account ofthe di aspect 
Surveys; see also Merton 1968: 157-62 ма = calls 
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Surveys certainly do impose on researchers a most awkward time- 
table. Properly designed, anticipating rival causal explanations as far 
as possible and building in ways to test them, surveys can provide 
evidence for and against different causal models. This evidence is not 
proof, however; it is only as good as the model is. 


Notes: Chapter 4 


1 The following discussion has been deeply influenced by the ideas of Davis (for 
example, 1976). 

2 Itis interesting that Phillips makes a big fuss about how little variance is normally 
explained and also about how unreliable sociological measures usually are. He fails 
dM that the latter may strongly attenuate the correlations used in the former 

3:7) 

3 The percentage difference, as Jim Davis drew to my attention, is just a regression 
coefficient between two 0,1 variables. 

4 | cannot support the idea that these two oc 
important sense. However, the word has bi 
find myselfbowing to convention. 

5 Iuse percentages and proportions interchangeably 
but prefer calculating proportions. 


cupational strata constitute classes inany 
ecome so widely used in this sense that I 


— | like talking about percentages 


5 
Adequacy at the Level of Meaning 


Two Sociologies? 


Marx complained in his first thesis on Feuerbach that the idealists 
had managed to get a monopoly on viewing human beings as active 
and creative. He put the blame on the materialists like Feuerbach 
who gave the ground away because they were not prepared to treat 


subjective states as real and has having a real impact. It isa complaint 
that could well be made ab 


in Chapter 3 how the dev 
insisted that subjectivity 
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humankind can achieve control over the institutions that it creates, 
and uses a vocabulary of social action, will, intention and meaning. 
At the heart of these two sociologies, he argues, is a different view 
about the relationship of man to society. These in turn give rise to 
different ways in which it is appropriate to investigate the social 
world, the former seeing it as more appropriate to take up the tools of 
natural science and use them to look at subjective meanings as inter- 
nalisations of externally imposed social norms, and the latter leading 
to understanding or ‘Verstehen’ as the key method of the social 
Sciences, in its attempt to get inside subjectivity of individual actors’ 
definitions ofsituations. Е 

_ Having delineated the two sociologies, Dawe suggests that the dis- 
tinctions between them comes down to an irreconcilable conflict of 
fundamental societal values, of security versus freedom, and that you 
must therefore just choose between them. However, the way in which 
he sets up the terms of the debate means that your choice is actually 
Not that free! Dawe argues very convincingly that the very core of the 
Concepts of subjectivity, will and action, cannot be derived from the 
language of the social order approach; in its attempt to synthesise 


action concepts into social system terms by deriving their meaning 


from social norms, the concept of subjectivity loses all its force and 
that, in viewing social 


Coherence. But he does not equally argue 1 1 

Systems as the result of interactions of individual unit acts, the social 
action approach cannot derive a plausible account of the social 
System. There is a confusion between the title of his article ( The two 
Sociologies’) and a statement in the article that ‘sociology has 
developed on the basis of the conflict between them’. If the two 
Sociologies were as hermetically sealed in their language and their 
Problematics as Dawe maintains, how would debate and interaction 


between the two Бе P 
ossible? 

he fact isthat ме is no logical reason why we should be forced to 
Select neat polythene bagfuls of social philosophies all at once, as 
Indeed all the major social theorists were centrally trying to show. 
Your research, your choice of subject and method, your opera- 
Uonalisation of Key concepts, and so on, is not determined by your 
SPistemology and implied ontology. What you discover is also 
‘termined, although not completely, by the nature of the social 
World. You cannot just choose whether to view man as active sc 
Passive. (Which would you choose, incidentally? It's not much of a 
thoice.) You cannot just choose whether social institutions come 
: fore or after individuals. You cannot just choose whether or not 


indi 
had been badly framed in 


oe have got ‘free will’. A 
ued earli i ‘free wi : 
ries aed. beings make choices, not 
between different courses 


m ue 
just p aditional accounts. Clearly human 
etween different evaluations, but also 
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of action and between action and non-action; being acera 
have the capacity to imagine A ај e ni sts е 
e it or prevent it. Causes and intenti ! 

ie Coy, ї will were indeed free, and I could intend ann 
achieve whatever I wanted, then there could be no у tel 
assimilating the two notions: events would be either wille са он 
But we recognised earlier that people may make history, they mie 
exercise choice, but they cannot choose the conditions, the uiri 
of possibilities open to them. To the extent that there are eene i 
on unbridled will, part ofthe apparatus of causality will be neede ae 
explain the structuring of these Constraints. Freedom, as Fa be 
argued, is the recognition of necessity; conversely, oppression so iie 
the product of unrecognised constraints. That is the paradox a des 
heart of some of the most exciting sociological explanations; stud! 

which can show the double-sided nature of the human condition, 
creating as well as experiencing social Structures, are the most pean 
factory ones to read. The best sociological questions are those enn 
aim to investigate the conscious, the subjective, the creative aspec 

of human action and to delimit the extent to which they are the key 
determinants ofa given outcome. i ss 

The adoption of the ‘plastic man’ bundle of goods which view 


Society as a constraining force over man is only politically vm 
Servative if and to the extent that it is untrue. But the setting о 
terms of debate in this s 


ealed-off form precludes sociology from ever 
asking the crucial questions of whether the constrained nature 0 
social man isa reality o 
the methodological co 
one example. Survey r 
man' package, incapab 
the ‘active man’ packa 


Weber's Injunction 
It was Weber who argued that explanations would only ђе 
satisfactory if they were ‘ade 


empirically established. It ho 
to provide such evidence, 


l of meaning, our generalisation’ 
istical probability, either not me 
Y intelligible; this is no matter ho 
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high the probability of outcome . . . and no matter how precisely 
calculable in numerical terms it may be. On the other hand, from 
the point of view of its importance for sociological knowledge, even 
the most certain adequacy on the level of meaning signifies an 
acceptable causal proposition only to the extent that evidence can 
be produced that there is a probability ... that the action in 
question really takes the course held to be meaningfully adequate 
with a certain calculable frequency or some approximation to 1t 
(whether on average or in the ‘ideal’ case). (in Runciman 1978) 


In other words, the mere fact of a high correlation between, say, 
Protestantism and capitalism, while being a necessary part of an 
explanation, doesn’t yield sociological knowledge until the reason for 
the connection is made intelligible to us. Nor will we be convinced 
that the ideas of a particular kind of Protestantism encouraged the 
development of capitalism on intuitively appealing grounds; we shall 
want to see the correlation established. The key question now 15 
Whether survey data is bound to yield only 'statements of statistical 
Probability’, or whether it can make its correlations meaningful. —— 

Unfortunately Weber did not give much ofa clue about how this is 
to be accomplished. The original statement is vague, opening the 
door to such difficult problems as unconscious meaning. Weare told 
that all social action is meaningful, and that behaviour performed 
without a motive is not of interest to sociologists, but it Is not clear 
What is ruled out by this, for Weber’s category of ‘affectual action’, or 
action undertaken for instinctive or emotional reasons, 15 still called 
action. It is sufficiently ambiguous for interpreters of Weber’s work as 
different as Schutz and Parsons to disagree profoundly about what he 
Meant. There have been several broad responses among Survey 
researchers to Weber's call for using Verstehen ог understanding in 
explanations, to which we shall now turn. The approaches differ Ah 
Whom they believe the meaning should be supplied by and how aig 
and what type of evidence is required before one can validly attribute 
Meaning to an action. In the last chapter we reviewed a procedure 
Which aimed, step by step, to establish an adequate causal explana- 
tion. Unfortunately no such neat formula exists (or probably he 
exist) for making surveys provide a convincing explanation of the 
Meaningful nature of the action for the actors involved. 


Facesheet Sociology 
ne early response to the idea t Edi 
Sociological explanation was to argue that it only na 
Benerating hypotheses, and was quite 
OF 235116 the success of an explanation ( 
that point of view must have something to 
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very phenomenological interpretation of Verstehen in more recent 
years. But an inspection of journal articles over the last thirty years 
will reveal that at no point did sociologists ever actually give up try- 
ing to present their correlational studies as plausible, cogent 
explanations as well as causally adequate ones. The majority of the 
arguments about the meaning of actions or events for the partici- 
pants, however, are supplied from outside the research context, with 
nojustifications whatsoever from the data. 

Over the years, there has developed a practice which we can use- 
fully term ‘facesheet sociology’, which uses a rather mechanical 
algorithm for coming up with sociological explanations. A 
dependent variable, an ‘explanandum’, is selected on some 
theoretical but more usually practical grounds. Experience has 
taught survey researchers that most variables correlate with some of a 
series of background variables, and so these are routinely included on 

— Sex, age, social class, occupation, 
gion, and so on (Davis 1979). The 
rrelating the dependent variable with 
riables, showing that women are more 


he way most fac s Ч : E 
article is by supplying i Sociology is dressed up into a readable 


i meani i Б : 
prende (The unreadabl aningful dimension of analysis from the 
one.) We ma Я 
У be told plains’ job satisfaction because 
occupation ‘explains’ vote ave lower aspirations than men, or that 


: J er unsuccessful, attempts to 
show that the choice of facesheet Variables and the success that they 
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have represent an implicit theory of socialisation (Baldamus 1976). 
But in traditional facesheet sociology these questions are not brought 
out into the open and theorised prior to data collection so that the 
mediating explanations themselves can be tested. 

And these explanations have a very ad hoc quality. There is rarely 
any justification of which of the background variables it was neces- 
sary to introduce. Religion is always brought in as an explanatory 
factor in Irish mobility studies, but its absence is never commented on 
in British studies. This suggests that there is some meaning attached 
to religion in Ireland that does not hold in Britain (which accords with 
what we feel we know of Irish society), and sociological explanation 
will only make headway when it has managed to pin that element 
down. 

However, in suggesting that this type of sociology is not adequate 
for providing convincing accounts of human action, I do not mean to 
Suggest that we should stop collecting facesheet data, and carefully 
checking in any analysis that we do that the inferences we draw are 
Not spurious because of the effect of intercorrelations with back- 
ground variables. It may even be that reflection on the generalisable 
findings from facesheet sociology will provoke better research designs 
to test some of the arguments that seem to be implicit in interpreting 
these correlations. A useful start in this direction has been made by 
Davis (1979) who has examined the cumulated results of NORC’s 
General Social Survey to see what generalisable statements can be 
made about the intercorrelations of background variables and their 
impact on dependent variables; this allows him to assess the average 
total effects of such things as age, race, religion, and so on, on a wide 
Tange of attitudinal data. ; 

Indeed, it is often the correlation between a background variable 
and a dependent variable which first stimulates the curiosity, as 


Rosenber, : ther than supplying the interpreta- 
à 2 (1968) points out. Ra аа назора 


ы and more refined intervening varia 
ing relegated to the role of a useful hyp 


Central part in the di lan 
j the disentangling ofan exp!ana: 
we can stop, by allowing us to judge at what point we have teased out a 
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sequence of events that makes the action of the participants plausible 
(Leat 1972). 

Facesheet sociology provides the problem for explanation more 
often than it provides the solution. The interpretation must come 
from the data, not from the outside. What kind of variables are going 
to provide correlations which satisfy us as explanations rather than 
puzzle us and provoke us into asking why this is going on? There is no 
one answer to this question, but it is generally true that they are pieces 
of information which allow us, as observers, to get an idea of what the 
subjective experience of the actor must have been like, and of what 
that actor might have been reacting to or trying to achieve in the 
circumstances. 

These are the variables that Pose the very difficult measurement 


problems; in fact, the problems are considered insurmountable by 
some, who, believin 


spection ort 
Now let me 


onditions. In the last analysis, the 
able to anyone but the actor (Nage! 
at organises subjective experience 15 
gh social rules and conventions an 
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ment of the questionnaire as an instrument of data collection, and the 
growing acceptance of the idea of a respondent as opposed to an 
informant, encouraged this strategy for sociological explanation. But 
asking actors to supply the reasons for their actions runs immediately 
into many difficulties. 

These problems were considered to be so overwhelming by one of 
the founding figures in British market research, Harry Henry, that he 
was stung into writing a paper in 1953 that has remained a classic, 
entitled ‘We cannot ask why’. In a series of examples, he compares 
the reasons that people cite for buying particular products with 
inferences that can be drawn about their purchasing behaviour from 
comparing buyers with non-buyers, and concludes that the actors are 
simply not a reliable source. The reasons that people give for buying 
any baby food are remarkably similar, regardless of the particular 
brand, and the researcher must use statistical analysis to uncover the 
real determinants, He is scathing about the possibility of using depth 
interviews to uncover motivations, a technique which he considers 
More appropriate to social anthropology, ‘that harlot among the 
social sciences’ (1953; 1971: 310). While he thinks that the problems 
of prestige bias are probably more severe ‘in the woman-dominated 
Cultures of the North American continent than. . .10 the more stable 
atmosphere of Europe’, he argues that it is a problem even in 
(macho?) Britain, and researchers here should also eschew this 
approach to understanding the determinants of action. те 

It is very important to decide whether the major problem is | а 
actors don’t know why they act as they do, or that it is hard to elicit 
these reasons. To the extent that we decide actors simply don’t know, 


then, in Weber’ : longer dealing with sub- 
ee er's terminology, we are по long ) f 
Jectiv i 5 haviour. Determinants о 

tively meaningful action but mere be t та лаке fff 


action which are not goi 
3 are unknown to the actor 
ehaviour ‘understandable’ to the researcher when m 
Uncovered through statistical analysis, either. However, 


ee i om consciously known, 
ple as that. There is a spectrum fr E et 


Perceived and communicable to the literally u : 
Хап through ihe: sit nae pat waters of the проври 
In a book on the Hidden Injuries of Class, Sennett and Cob А Fite 
argue that the psychological damage inflicted by class "p y ~ 
great that attempts to get at it by asking direct questions 9 сар 
against the Freudian syndrome of repression an denia З eni ini 
whether to characterise this as a problem of actor's aea e is 
explanations, oractor’s ability to communicate them, reveals : 
UNA between the two problems is not as watertight as we may 
€Viously have thought. m 
is n influential el of social psychology holds ie eres 
опе of access; it has tried to demonstrate that the rules о 
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and logical inference used by actors and outside observers to decide 
what produced a piece of behaviour are essentially the same. It is 
argued that actors do not have any privilege in access to explanations 
of their behaviour. If you ask actors to reflect on the determinants of 
their behaviour, they appear to produce a priori culturally plausible 
explanations (similar to the explanations observers might produce) 


and only use their private experience to check that it does not 
blatantly contradict the facts. 


Tesearchers have Nothin 
example, they emigrated 
there area Tange of const 
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qualities ofthe actors; it is almost as if actors are denying their ability 
to choose while observers are according it to them. Buta little thought 
reveals that actors well understand the importance of Engels's idea 
that freedom is the recognition of necessity. One way for them to 
preserve their experience of personal autonomy and ability to act 
rationally is to emphasise the way in which their actions were a 
response to a given environment. The fact that there are unperceived 
constraints on action, as Nisbett and Wilson showed, doesn't under- 
mine this point. The reason actors don't attribute their own 
behaviour to personality traits is probably because this goes against 
their existential perceptions of themselves as free to react in any way 
they wish to a situation. But why should observers look for dis- 
Positions in actors, especially when there is scant evidence of major 
Variation between people in these personality traits? It might be that 
Observers mainly see most social actors in only one *role' and so fail to 
Perceive the rich variation in personality of most other people. Any- 
Way, the observer who perceives personal traits of ‘hostility’, rather 
than merely ‘hostile acts’, also gains a sense of predictability and 
Control over the environment. = 
What does all this tell us about the survey researchers’ likely 
Success at extracting valid reasons from those involved? The first 
Point is of course that people with the opportunity to see a range of 
Cases are not just ordinary observers, having access to a type of 
explanation not available in any other way. But, secondly, like other 
Observers, they may be likely to attribute actions to dispositions 
Tather than to rational responses to circumstances, and the 
Popularity of attitude and personality models for which there is little 
empirical support would seem to suggest this. Asking the actors may 
act as a corrective and ensure that those factors are supplied. We are 
alerted by these experiments to the common biases of both ec 
and observers’ attributions, which we can take into account y en 
Cvaluating the reasons they provide. Thirdly, actors as such do have 
Privileged access to their own experience but not to all the determin- 
ants of their own behaviour. However ‘plausible’ or aora и 
ae Of meaning’ their responses are, they still may not : Ric d 
“equate. Their reasons are often much better informed а 
teresting in their own right, but have no logical status over “he 
z ST explanation. If for any reason there are di fficulties in Den ie 
“quired information from the actors themselves, there 1s no 


against us n i ings 
1 al meanings. К 
ng observers to supply the soct bout the use of actors 


n Summary, we cannot agree with Henry 
а Зов, Actors do know а а deal about why mey шет ми 
the апа we must not eschew the insights they have. Е парење 
Chie: with circumspection. As with so many © the Я 
11515 that are made of survey research, this is better seen as 
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caution against asking why-questions inappropriately or badly, over- 
interpreting the results, rather than a reason for abandoning the 
attempt. 

But even if we reject the idea that there are principled objections to 
thinking that actors have access to their motivations, there are still 


1978). It has b 
individual ques 


d and why. 
E ns E have faced these problems for many deu 
n Vie em have come to the conclusion that the bald quest - 
ba. never be used. But they have elaborated a set of t f 
nown as ysis' in order to try to overcome some о 
4 shin 1968). Since the determinati ious 
à Te SO complex, as we saw in the pre 
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Purchaser (for example, a regular habitual purchase) (Lazarsfeld 
1972). Since the reasons for a decision will not be common to all 
respondents, the interview schedule for an inquiry about motivations 
must be quite flexible and adapted to the concrete experience of the 
respondent. It will almost always require an experienced interviewer 
to conduct a depth interview (- perhaps it is appropriate for the 
‘harlot among the social sciences’ to have come up with the method 
Most suitable for ‘soliciting’ reasons!). 5 

But undoubtedly the most complete and most influential model of 
action that has been elaborated in sociology is that proposed by 
Talcott Parsons. Actually, he did not just propose one, but in the 
Course of his intellectual development and interactions with Shils 
and Bales, he proposed a series of different models. These could be 
treated as ‘accounting schemes’ for reason analysis. In Toward a 
General Theory of Action (Parsons and Shils 1951, ch. 2) the authors 
Consider action most clearly conceptualised as being oriented 
towards ‘objects’. As they explain, ‘action has an orientation when it 
1S guided by the meaning which the actor attaches to it in Its relation- 
ship to his goals and interests’ (1951: 4), and there are two major ways 
In which such meaning is invested in objects. First, the actor or actors 
may have motivations with regard to the objects, either believing 
them to have particular properties, or just investing emotion in ages 
Secondly, they may make evaluations, according to ee o 
truthfulness, appropriateness, or rightness. However, as Kadushin 
(1968) notes, this scheme ‘has been used more frequently for peo p 
11р typologies of actions and institutional norms than as guides 1961) 
analysis of concrete decisions’, and this is probably why Rex = in 
and Giddens (1976) have criticised the theory of action for being 
Over-deterministic, 


З ; iologists 
^s The search for general orientations of actions. Many y da ste 
© have used Parsons's ‘action frame of reference 


E : е 

он иед on producing explanations of behaviour oak po 
Ntations i le's behaviour thro А 

own to , making sense of peop fife. A wide variety of 


: their way of ordering their priorities in | 
offerent pieces of empirical research in Britain, for emoe 
‘ori of David Lockwood’s classic paper on t ye tain, the 
пад atiOns' to society that were to be found in sg (Bulmer 
19 Попај proletarian, the deferential and the Li seal studiesof 
Ew he most famous of these were the Affluent dio "o hig 
Golde e"s in the rapidly expanding town of зог must be 
thorpe and his colleagues argue that work behav! : 


Under, ; :entations to life, 
Not а. 9d as a product of the workers overil е тан fulfilment. 


asa 5 
T Tesponse to technology or as a persona ob 
here are a group of Verden. hey argue, who work for pay, not J 
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satisfaction, who fail to form close work groups, who have con- 
tractual, money relationships with the boss, who have an 
instrumental approach to the union and who see advance in terms of 
domestic standards of living, not in increased occupational satisfac- 
tions. Their point is that this instrumental worker is pursuing a Very 
different life project from the traditional worker, and failure to 
understand the different evaluations they place on different parts of 
their lives will lead to misunderstanding much of their work 
behaviour. 

But, despite the theoretical importance of this argument, the 
Affluent Worker studies started life as part ofa very different research 
Project about the ‘embourgeoisement’ of the working class, which 
made Luton a particularly critical area to test the original thesis In, 
but a poor location for a study of the independent importance 0 
instrumental orientations. The authors do not attempt to measure 
the orientations directly, but rather are prepared to use patterns !n 
revealed preferences — that is, actual choice — as evidence of the 


ave 
not been very successful, at” to structured groups of beliefs h 


n on such prominent « 
(Converse 1964) бе 65 the Left-Right 
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spectrum (Butler and Stokes 1974: 328-31). Values, rather than 
being stable and coherent, are often highly labile and wide open to 
bias in elicitation (Fischoff et al. 1979). There is even some suggestion 
that the more topical, specific attitude items, where the marginal 
responses fluctuate over time, are more explicable in terms of back- 
ground variables than are the more general questions about people’s 
values; the correlations between background variables and concrete 
items on racial matters or freedom of speech, for example, are much 
higher than the correlations with qualities looked for in a job. This 
means that values have little chance of entering as intervening 
variables to provide the subjectively convincing link between the 
background and opinion items (Davis 1979: 42). 

Rather than admit to the measurement problems, researchers seem 
to prefer to attribute the failure of their measures to correlate with 
other beliefs to the respondent's inability to see theimplication ofone 
set of ideas for another. They talk of ‘fragmentary class conscious- 
Ness’ (Robert et al. 1977) or distinguish in a rather supercilious 
manner between ‘ideologues’ and *non-ideologues' (Converse 1964). 
But often the attempts to measure these values are very thin. 
Compare, for example, the richness of Durkheim's concept of 
anomie, the state of insufficient regulation by social norms, and the 
batteries of ‘anomia’ measures that have been devised for use in 
surveys (see, for example, Seeman 1959). Critics of these superficial 
Measures have objected to the reduction of such a full and theoreti- 
cally rich concept to questions about feeling hopeless (Horton 1964). 
In short, it is in principle possible to establish the existence of values 
and orientations independently, and to avoid the circularity which 
comes when they are inferred from behaviour. On the other hand, 
their greater stability has never been adequately demonstrated, their 
Power as intervening variables is not sufficient for them to provide 
the bridge of interpretation between background variables and 
Specific dependent variables and they have never been very 
adequately measured. They are not the panacea to the problem of 
action, nor have they proved to be the basis of a generalisable set of 
i peHans about the sources ofa wide variety of different types of 

ction, 
. So there are sev ifficulties both in getting actors to account for 
individual roi rg a discovering any broad goals that people are 
Pursuing which could account for their actions. They are not always 
Insurmountable, but they require Very careful survey design. 


Meanings Supplied by the Researcher: the Social Origins 


of Depression 
ere are, however, situations in which the researcher mey feel mar 
the actors cannot validly provide the data for a plausible account о 
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their own behaviour. This does not mean that we must abandonne 
search for a meaningful explanation in these circumstances. E 
individuals may still be reacting in an understandable way to га е 
that have happened to them, even though they are not ina Ва Әр i 
explain this to a researcher. In such circumstances the researc vem 
have to read the meaning into the events. The example that da 
chosen to treat in more detail in this chapter is one that is pw the 
pursue this strategy because it seeks to explain depression, an 
actors were not felt to be suitable informants, as we shall see. 


Depression is ostensibly a deeply individual state of mind, con- 
sidered the domain of t 


But in The Social Origi 


It is a theoretical projec 
Suicide. Although the lif 


: penerated from those who had sought help from 
agencies Which might then have i i 
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contained the biases that are known to result from selective recogni- 
tion of suffering and selective referral processes which bring people 
into contact with their GPs or with hospitals. The only solution was 
to conduct a careful screening survey, and this was confined to 
women living in the Camberwell area of London for logistic reasons, 
since depression is much commoner in women than it is in men.! 
Several comparison groups were also sampled, in- and out-patients 
of psychiatric hospitals, a group of women being treated for 
depression by the GPs and a sample from the Outer Hebrides, but I 
shall restrict my discussion to the Camberwell sample. 

The authors note that the survey ‘has great potential, but, with 
some exceptions, its promise has not been fulfilled" (1978: 13). They 
attribute this failure to problems with measurement, and bemoan the 
reliance of many researchers on 'some form of the standardised 
questionnaire, with dispiriting pretensions to measure almost any- 
thing by means of a few, often fixed choice questions’ (1978: 10). 
Their solution isto combine the advantages of intensive interviewing 
for adequate measurement with extensive sampling for valid causal 
inference. Once again, we can see that depth interviewing is often 
required for the production ofmeaningfulexplanations. — , 

„There are several difficulties associated with classifying indi- 
viduals as depressed: (1) It is not uniformly an actor's category. In 
fact, most depressed people tend to talk about their ‘nerves’. (2) Every- 
one undergoes mood changes, and suffers grief at some point in their 
life. The difference between this and clinical depression 15 а 
Quantitative one of intensity, duration and extent of distress, but 
Where does one draw the line? (3) The very idea that it is an “illness 
has been attacked, on the grounds that the medicalisation of mental 
illness robs people of their moral responsibility. The answer to the 
first problem is that this means that the task of measurement 15 more 


difficult, not і i ible; t actors’ characterisation 
, Not ipso facto impossible; to accep 
p у ld mean that the extent of un- 


of depression used was one based on symp г 
about the existence aiming, intensity and duration of these was 
Collected systematically by something rather like a standardised 
clinical history, drawing the lines as far as possible in the same place 
85 psychiatrists. To the objection that mental illness should not be 


treated on the * ; , 
e ‘medical model’, the au Г 

there certainly is a recognisable group of symptoms which commonly 

Occur together, and deserve some label; they can also point to the fact 

that these bring such distress and suffering with them that they often 
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i ing out a 
do have the effect of preventing me person som en и eae 
i i free life. But, in the last analysis, T 

ern не i illness or not does not really 

er you chose to call depression an i : ven 

Foros research. One can show that a constellation of pesce 
commonly occurs together, such that one can identify a sy 

i i L | 

se existence is not dependent on the labe : — 

ia - deciding whether to concentrate on symptomatic uae pea 

depression, the authors take a strong line against aetio x do: be 

fication. Durkheim was convinced that classifications ne ict 

aetiological and not morphological, as he termed gr id. be to 

words, when you made a classification, your aim shou s Le bs 
separate things with different Causes, not just things that seem 


5 x en he 
different. It was something along these lines that Plato meant wh 
said that the task of conc 


problem about an aetiol 
exploratory phase of an 
relationship you can fi 
other variables. This 

characterise a person 
depressed, you are com 
first case and another s 
indeed carved reality a 
no evidence that this 


3 


4 сша 
mood, changed eating patterns, se 
tension, obsessional Symptoms, and so on, over the past year, ! 


: wi 
nformation to decide whether the person ` 
either chronically de 


ell. 
€pression among the population of Camber! 
Seventeen perc 

clearly had a di 
treatment, in th 


. i um 
borderline (197; 37). If the women were working class an 
Children under the age of 


30and20 percent respectively, 


1 e ‘life events 

esearch in many different places has suggested that life Tut 
are of central importance in provoking an onset of depression. 21. 
far from arguing that the 


5 
ination 
Se events are external determin 
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diametrically opposed to subjective states and desires, the authors 
argue, in sympathy with the Verstehen tradition, that it is the mean- 
ing that these events have for the subjects that gives them their causal 
force in provoking an onset. But how is this meaning to be 
established? The difficulties of viewing actors as having privileged 
access to their own motivations are compounded when the subject is 
depressed. Brown and Harris reject the idea that the method of intro- 
spection is the only one capable of yielding meaningful attributions; 
they claim that it is possible, if an outsider has enough detail, to see 
how a typical individual would react under similar conditions. The 
dispute that has raged between the phenomenologists such as Schutz 
and positivists like Durkheim has not been over whether one should 
use such judgements about the meaningfulness of an experience for 
somebody, but how much information is required before that can be 
done (Brown and Harris 1978: 89). If there do indeed exist common 
Social meanings attached to institutions and events, then it should be 
Possible to get at them in a reliable manner, the validity of such 
attributions does not depend on the respondent's acquiescence 1n the 
attribution. . МЕЛЕ 
The argument of The Social Origins of Depression 15 that it is life 
events which pose severe long-term threat to the individual that cause 
depression. In evolving measures of such life events, Brown and 
Harris make a generally valid methodological distinction between 
units and qualities, and argue that the two must be measured 
separately. Whether a life event has occurred to a respondent or not 
must be assessed in a manner that is uncontaminated by the degree or 
quality of emotional response it provoked. Establishing whether a 
respondent lost her job in the preceding year 1s 2 separate task from 
estimating the degree of anxiety associated with a loss of job. its 
Parsons argued that all concepts can be crudely divided imo c s: 
and qualities. A unit is part of reality, and it makes sense to talk abo 


unis rising in their own rit aou Pee eee One 
Stract uni i rily have physic a 
ts which do not necessarily F haracterise these 


we have decided what the units are, it is possible to € r 
а by means of various analytic concepts, general арте“ а 
ES only observable in the particular. In short, units are W rim ings 
194 and analytic concepts are the qualities that units possess (Parsons 
9: 27-41). This is a distinction with general validity, not just ina 
Particularly subjective emotional area. А МЕР 
€ twist that Brown and Harris add to this discussion is to argue 

at one should be searching for units and qualities which are distinct, 
Ut yet related to some extent. ‘If the correlation between unit and 
iy is too low, we risk collecting a good deal of data of little 
а Tinsic interest; if it is too high, we will run into the kind of 
reularity that we set out to avoid’ (1978: 345). Separating out the 
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re- 
unit from its analytic qualities at all stages of the рона а pot 
ment prevents the kind of circularity mentioned gue as a m 
example, we can separate the unit ‘changing job a E ib 
which might be associated with it, then we will be able oe ges 
statement that changing job leads to higher rates ofanxie У. Nox 
not made this separation, empirical investigation will be erum ena 
Itis important that investigators make this basic бинде емнае 
conceptual framework, but the distinction has to be carrie valities 
into the measurement task, which is quite difficult when the q M ant 
are meanings which are intimately bound up with the VE ied 
when the outcome is depression. Let us consider first the recor 
the units, the incidence of life events. f clinical 
There is always a danger that knowing that a bout o Нави 
depression followed a Particular event would induce the respo The 
to remember it particularly or a 
authors cite a study of Down's 
chromosomal basis 


В ectiV 
» been ill, and so on, to try to cut down se 
memory by the dep i 


Tape-record 
main study, 


А thus to improve its ases ава 
Check the validity of these questions, additional repo 


essed 
? i ~ th 
People, si € of being depressed. Great attention wa the 
to timing to avoid Tespondents bringing events forward i 
Period of interest. 
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Betting raters to judge how threatening and anxiety-provoking such 
events would be to the average person. Thus the meaning of the event 
was supplied by having very full information about the context of 
each woman's life including her hopes and plans, and by outsiders 
Judging the seriousness of the event in that context (for a fuller dis- 
cussion of this see Brown 1981). The people who did the rating from 
the tape-recorded information were not told whether the respondent 
got depressed, and the intercoder reliability of the judgements were 
checked. The reliability proved to be very high after training, and 
after rules had been established about what should and should not 
count. They did also ask the respondents themselves how they felt, to 
See how these responses compared, and the correlation was fairly 
high. The resulting scales are models for how social meanings may be 
reliably measured. Our critic, Cicourel (1964: 107), asked: ‘[C]an we 
assume that the interviewers, ethnological "scouts", coders, data 
analysts and the director of the social science research are all employ- 
x the same theoretical frame of reference and interpreting each 
hee respondent, etc., identically?’ His answer was negative, but 
'S 15 precisely what a carefully designed and controlled research 
Poest has as its goal; even if it cannot hope to succeed completely, it 
a n make a good attempt. If one stuck too closely to Cicourel’s 

"gument the best would certainly become the enemy of the good. 
ina € coders did not establish the meaning of these. life events 
тета ently of the context in which they occurred, which you will 
pie Me Was a large component of the complaint of the ethno- 
thre Odologists against survey research. The raters had to judge how 
inns to an individual in her particular circumstances any 
ries event was; to be rated as severe it had to necessitate a general 
ome et of life and its meaning, and the threat that it posed to the 
B had to be relatively long-term. Childbirth was not normally 
i Severe unless it happened in a context of bad housing and 
его 5 Of money. In one case the death of a mother-in-law shortly 
mothe the birth of a woman's child was rated as severe because the 
ei Sr-in-law had been relied on to babysit to allow the woman to 
depen’ work. The fact that the meaning of an event is context- 
reliably 11 does not preclude establishing meaning objectively and 

Y ifsufficient contextual information is available to the rater. 

бово do Severe events provoke depression? By definition, they are 
ch о which pose long-term threat to the individual, and as 
looked б, constituted 16 per cent ofall events. Brown and Harris next 
turned 9r the components of these events, and the great majority 
With а Out to involve a loss or disappointment. This is compatible 
Physic; y choanalytic theory of grief. The loss need not be of a 
Oss, 5 Object or person. It could be disappointment or symbolic 
r Such as the loss of someone's conception of her relationship with 
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i ingthe 
her husband on discovering that he had heen peda ge dier 
i eveale 
own into component parts thus ri 2 L 
ve whereby severe life events have their causal isa SI 
Ne can summarise the lessons to be learnt from this study 


e а :neful 
systematic measurement of qualitative, subjective, meaning 
aspects of social life as follows: 


i trated 
(1) Categories used in social research do not have to be demons 
to beactor's categories. 


itudes, 

(2) It helps if one can show clusters, or syndromes, of attitu 
emotions, or whatever. í К ; — 

(3) Where the intuitive judgement of outsiders is required, great 


: : inter-coder 
must be taken to demonstrate that there is consensus; inter 
reliability is vital. 


(4) Explanations ofthe form 


meaningful 


—————MÀ outcome 
event 


Tun an omnipresent risk of circularity: 


(a) the outcome ma 
researcher to imb 
at the time; 

(b) the outcome ma 
Particular events 

(c) if the event is p 
tinguishitasane 


А ; r the 
y lead the respondent, the internen Taye 
uea previous event with meaning it didn 


only 
y have been defined in such a way that 
could possibly explain it; , dis- 

Sane Aedes ; o 
urely subjective, it may be impossible t 
xternal, separate event. 


These lead to the following rules ofguidance: 


s 

у Е T А dent а 

(а) make measures of units and their qualities as litt 
Possible from measures of outcome, aiming for a 
Correlation between the two; 


(b) avoid aetiological classifications, 


(5) Complex variabl 


е down 
€s should wherever possible be broken 
into their compo 


nents for sharper clarity. 
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nad 8 combine these carefully measured variables into a 
о depresion, which is also adequate at the level of cause; this 
RRR de eloquent refutation of philosophical arguments that 
е ranne are incompatible in one explanation. The 
PARIES о much research on the aetiology of depression came 
Brad eie ing, contrary to common assertions that it is a middle- 
пред phen menon, that it is much more prevalent among working 
finding: f among middle class women. This study replicated the 
Permis om other epidemiological studies. Table 5.1 shows that 7 
у jeg working than middle class women get depressed in a 
у ЈЕ ee . One might be tempted to remark that the association 
kia Se but one would be suspicious of the independent 
un class if the correlation was much higher. This is the zero- 
r relationship that many studies have tried to decompose, if 
Possible to ‘explain’. | 


Table 5.1 Proportion Depressed by Class" 


Working Middle 
class class 
0:124 (N 2209) 0:052 (N 2210) 
4=0:072 


Source: Brown and Harris 1978: 168. 


sare hypothesised to cause 
measured these carefully, 
from the measurement of 
tablishing independently 
sed people, it could still 


Prior have already been told, life event 
separating | and Brown and Harris had 
their ing the measurement of the events 
that а impact. But, even after es 
: idt events did happen more to depres s 
intervi е events were effects rather than causes of depression. fhe 
bossibili were therefore instructed to probe to see ifthere was a 
Кеа lity that the life event had been induced in some way by the 
Pression; if, for example, a woman was ОПО ofa whole section made 


r $, . me 
апалі, this constituted an ‘independent’ life event, but ifit could 
€ been incipient depression that brought about the job loss, it was 
events were labelled as 


n 
Iu counted. Three-quarters of the. led a 
relati endent and one-quarter as possibly independent, but since the 
a ionship between both and depression was similar, it would 
m that one can rule out the hypothesis that the direction of 
d force was from depression to life events. Once again, we are 
lecid to conclude that only sociological reasoning will allow us to 
tryi € which variable is cause and which effect. This solution of 
Ng to establish which is the independent variable is vastly superior 
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: in the 
to the magic tricks of the econometricians that we touched on in th 
ter. VES. 1 

jio е? occurring at one discrete point in time were ne ios voee 
adversity these women faced. There were also a bees bem 
difficulties — a son's taking drugs, a damp flat - whic dps е 
as potential factors in provoking depression. They ha pent as 
ongoing for at least four weeks, and their come Piae awn 
textually in the same manner as life events. Those di icu S ieh 
were rated as severe enough to cause unremitting distress, an health 
had lasted at least two years (and which did not involve any mac 
problems as these were considered separately), were classed as 
difficulties. ‘ 

The weight of problems that these women faced makes pia here 
reading itself! It cannot be adequately summed up by the raw iing 
tics that the sample between them suffered 1,400 events invo ps 
sufficient disruption to their lives to arouse strong emotions, + tel 
knowing that one-sixth of the women experienced an even Ung 
brought with it long-term threat, or that half were риа ON ys 
enough difficulties to cause them marked distress. Table 5.2 5 


Ds М vents 
the summary association between provoking agents (severe € 
and major difficulties) and depression. 


Table 5.2 Proportion Depressed by Provoking Agents 


No severe 
event 
0-016 (N=255) 
d-0:186 
Brown and Harris 1978: 168. 


Severe 
event 


0:201 (N=148) 


Source: 


The next thing the sury 
ould explain the class d 


n 
| Ong the working class (d= 0:229) than eo à 
the middle class (4 0-] 20). But there is still a class difference rem 
5 ап 
ow the life events operate symbolically. 
hope that this will further i А 
get depressed. 
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Table 5.3 Proportion Depressed by Class by Provoking Agent 


Working class Middle class 
No provoking Provoking No provoking Provoking 
agent agent agent agent 


0:018 (N=112) 0:247 (N=97) 0:014(N=143) 0:134(N=67) 


Source; Brown and Harris 1978: 168. 


Brown and Harris’s theoretical formulation owes a lot to 
Durkheim, and the central importance that he placed on the regula- 
tion of individuals by society. Their argument is that depression is 
brought about by life events which are perceived by those to whom 
they happen as constituting a threat ofsome kind, most often because 
they involve the loss of something valued. Any changes of a 
sufficiently all-embracing kind can enforce a consideration of what 
one’s life is about, and can threaten one’s sense of the meaning oflife. 

hen this happens to those who are already vulnerable through 
Some factor in their situation, the anomie that develops is sufficiently 
acute to engender depression. Vulnerability to depression, they 
argue, is associated with factors which have the effect of lowering 
опе self-esteem. Not having a job, having lost one’s mother at an 
carly age, lacking an intimate relationship with a partner and having 
three or more children under the age of 14 at home all seem to place 
Women in this condition of vulnerability, and Brown and Harris 
argue that they can all devalue a woman's sense of her own worth and 
thus reduce the resources available to cope with difficulties. 

In other words, the life events, through inducing change, force 


People to refl ir li hole and its inherent meaningful- 
ect on their life as a W f.esteem has been run 


Dess. When th h 

ey occur to people whose eem Nas 

rown for some time because of some aspect of their situation such as 
ving to chase around after young children 

eon from a close relationship with a partner, ee 

ery much more likely to experience such profound wo Ў 


ase esteem, but there is no way in which t 
ssed i а 
ee TUN jated concept of an 


Variables А 
„ables must be treated as directly proc ss. 
facilitating agents, affecting susceptibility 10 bel causal process 
` Леу also introduce a third type of cause, Se 

ty uence how the cause will ‘express itself — here as m the 
Pe, intensity, and so on, ofthe symptoms which form. 
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Table 5.4 shows the joint effect of one of the vulnerability ме 
lack of intimate nine. and C pi sia ber Eo eee 
shows that a life event hasa arger effect on ; se 

ina vulnerable condition (d=0°29) than among p 
аа ое (4=0:09). It is not just that a pene ial 
hopelessness overtakes one when awful things, things oce. em 
of some kind and therefore threatening, happen. ea acy meee 
argue that if you can weather these storms you not ee S Fi d 
might feel good, for reward can be gained from the i sede Saee 
withstood adversity. But similarly, they hypothesise that i gs des 
ideas are lost and the feeling of hopelessness is generalised be 


It is 
the subject has a low sense ofherown worth anyway, then the resu 
usually clinical depression. 


Table 5.4 Proportion Depressed by Provoking Agents by Vulnerability 


Vulnerable Not vulnerable 
e 
No severe Severe No severe gen 
event event event even 


0:03 (N=62) 0:32 (N 2 76) 0:01 (Nz 193) 0:10 (N 288) 


Source: Brown and Harris 1978:ch. 11. 


. . . : Ll 1 in a 
Central to this theoretical argument is a statistical one involving 
Substantive interpretation 


А : ritt 
t of the concept of an interaction IE 
and Smith 1979), The definition that they used was one that w em 
Ф, à difference in differences of percen 


0:09, 
: Я on non-vulnerable women is only 
which we can call an interact 


| ОЦИ 56) inter- 
t Square with our intuitive idea of an i 
action — an effect only worki i 


es 
1 1ng went wrong? At the moment, her chanc 
of getting depressed 80 up from 1. to is if something лаа 
they would go up from % to 1 under the changed | sede y 
Although in each instance this amounts to a tenfold increase. 
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Still has little to worry about in practical terms from being in a 
vulnerable' state per se, but a lot to worry about if something befalls 
her while in that state. It seems reasonable to describe certain 
Situations as making the person involved ‘vulnerable’. 


Table 5.5 Proportion Depressed by Provoking Agent by Vulnerability by 
Class 


Vulnerable Not vulnerable 


Provoking No provoking Provoking No provoking 


agent agent agent agent 
Working 0:34 0:07 0:12 0:00 
class (N=56) (N=30) (N=41) (N=82) 
Middle 0:25 0:00 0:09 0-02 
Class (N=20) (N=32) (N=47) (N=111) 


Source: Brown and Harris 1978: 359. 


Table 5.5 shows that the lack of a class effect in depression among 
those with no provoking agent is borne out here; there are only two 
very small Ns cancelling each other out, so we shall concentrate 
attention on those who have a provoking agent. Vulnerability has a 
0:22 effect among the working class and a 0:16 effect among the 
middle class, Likewise, being working class has a 0:09 effect among 
those with a provoking agent and a negligible 0:03 among those with- 
Out. Now we have reduced the question of the class difference in the 
Proportions who get depressed to a simpler issue: why is there this 9 
per cent difference between the middle class and the working class 
among those who are both vulnerable and who have experienced a 
Provoking agent? Brown and Harris show that it comes 6 fact from 
the different severity of vulnerability in the two class groups; of 19 

pressed working class women in this situation, 10 were “а 
Condition of ‘severe’ vulnerability, having three or more of the 
Vulnerability conditions, whereas only 1 ofthe 5 middle class women 

as. 


Conclusion i 

aking sense of social action in a valid manner iven ia ae 
Surveys have not traditionally been very zu er d М fbri 
Survey researchers started a tradition which continues today o E the 
ing the meaning from the outside, either by making a of the 
Tesearcher’s stock of plausible explanations, derived from history or 
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inging i bsidiary depth inter- 
аа а ph to the у 
і sprinklin nud 
kb de n derived from the survey. Survey oe Mes he 
more exciting to the sociologist when it eean eu inches gr 
meaningful dimensions within the study design. e ves a ird 
two ways of achieving this in this chapter. The first a i mna 
the actor either for her Teasons directly, or to supply дакле и 
about the central values in her life around which we may sufficiently 
is orienting her life. The second involves collecting а РИН 
complete picture of the context in which an actor finds e Е ебу 
team of outsiders may read off the meaningful stele, a see 
checking that they are doing so in a consistent manner. soleo 
method is the only one available when the subjects are not T 
communicating the meaning of their actions validly. In nen ra 
we have just discussed in detail, it might be argued et eoe 
depressed is hardly a form of social action in the sense t IS за 
meant by that. But we should turn this argument round; the eta У 
to think that it is only action that is human and understan 
reactions are too. indeed 
The problems we came Up against in this chapter are 

immense. Very oft 


N H > ost- 
Structured questio: hers have painstakingly aie 
code the qualitative information that is collected. It is hard to enst 
that one has included 


ofthe relationshiy 


1 xplanation: thise 
de. Once again, there is a danger that sociologists will sympa 
with Philosophical 


ey ibility 0 
arguments about the a priori impossibility 
reconciling causal a 


1 ; ing [0 
: nd meaningful accounts instead of resolv 
Pilot their surveys better next time. 


Notes: Chapter 5 


8 effects 
l Because the subjects of this study are all women it can say nothing about the” so 
of being fe те no males for comparison, thus putting P If people 
rather ignorant ‘feminist’ criticisms that have been made of Brown's work. 
j Tiction to Camberwell. le 
The discrepancy between the 4 he total numbe 
reported on p.114 comes from the fact that the 17 per cent were t 
depressed in the las 


; ic 
5 es in whl 
t year, whereas this percentage only refers to those cas 
onset occurred duri 
aetiology would be very difficult. 


6 


Political Applications of Survey Research 


T j М 
poate comman belief, among sociologists at least, that there is 
меа ntrinsically manipulative about survey research: the 
lary of Fr we to describe it come in particular from the vocabu- 
political ie urt Marxism - scientistic’, ‘technicist’. It is this 
PN oe of positivism which has the strongest power to 
еа sociologists’ neglect of the survey method. The aim of 
ofits ee i to investigate the source of this belief and the validity 
‘manipulati irst, however, some confusions in the conception ofthe 

hee enon involved have to be clarified. А 
Bierce fo re two quite distinct ways in which surve 
which ca eener, have been held to be manipulative. The first, 
about th n be called abuse of power’, recognises that knowledge 
паба! е Social world, in an analogous way to knowledge about the 
do foe gives power to those who own or control it, and hence 
SDDiOVE co the wherewithal to put it to ends of which one may 
torent or disapprove. The second, which may be called ideo- 
the а, asserts that the so-called knowledge about 
realit Jal world is not knowledge which is grounded in outside 

Y but is an ideological reflection of some kind, created through 


Pins or reified means, whose acceptance furthers particular 
some 5. You cannot make both these criticisms at once: either 
Sine cular piece of knowledge is powerful enough to endow its 
Plur $ with a real basis for action when they intervene 1n the world, 

is artefactual and serves as the basis for various ideological con- 


Structi o 
Tuctions. There has been a tendency to present both criticisms of 
gside one another without 


5 
cing p c Pecially opinion polls, alon nother 
rankfi 1s contradiction. (See Lessnoff 1977 for a discussion of the 
pheno ut Marxists in this light.) Surveys of objective or subjective 
Opini mena raise the possibility of the abuse of power, whereas 
ion pollsare the correct object ofa criticism ofartefactuality. 


urveys, or social 


De 2n 
ин of Survey and Poll 
5L however, there is a definitional proble 


о 
Pinion poll as distinct from the kind of survey, 0 
he last two chapters. 


el É I 
3. and attitudes, of the kind discussed in t 1 
poll is sometimes made by 


distincti 
ac ion between a survey and a 5: 3 
TM tivities by gracing them 


m of classifying an 
ften of subjective 


Mics to elevate the status of their ac 
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with a Latin-root word, as opposed to an Eo iei 2 
(Schuman 1979); as such, the distinction is pointless. я Heu 
make a distinction between two different ideal types pe а 
distinction not based on location (university versus ie nr 0 
company) or methodological Sophistication, but on the n nich 
which the survey performs, and the differing P pai d 
ensue. A survey is performed to better understand somet oe of 
claim for an opinion poll is that it can be part of a proce de 
democracy. I stress that the argument is about ideal ud 
particular piece of research is likely to have elements of each. 


3 5 А а of 
are dangers in using the potentially teleological language 
functionalism, but we may follow these rules: 


(1) Orientation to the s 
individuals are treated as 
be interviewed because 


he 
ubjects of the research. In a Re o 
informants. They are people who ha 


à : ut 
only they can provide the details и 
aspects of their inner psychological life that the researcher is 1 


А ; ta. 
ested in, or because they are the most effective source for other da 
In polls, the respondents 


na poll, the respo 
cent line is important, b 


le 
ments about what the Majority think. If 63 per cent of the peoP 
believe that big busi 


. + 1 to 
Ness is too powerful, this is creamer dnt 

referendum on the subject, and the suggested consequences о have 

responses is that somebody should act on them. The people 
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decreed what the problem is, and it is for the government to act as an 
executive and find a way of fulfilling the decree of the people. 


(3) _ Orientation to action. Inconsistency between attitudes voiced in 
an interview and subsequent behaviour is not problematic, or 
Surprising, for the survey researcher. Indeed, one often finds that the 
consistency itself is the most interesting part of the research find- 
ings. Verbal methods ‘may be used to get at what people think, or at 
least what they think they think, but not at what they actually 
express in social situations’ (Galtung 1967: 112). But in polls, this 
consistency is glossed over. All the respondents are treated as 
citizens with clearly articulated and rationally considered views 
about some aspect of policy; what they say and what they do are pre- 
Sumed to be in harmony. 


vm Orientation to policy. The policy consequences of survey 
i ms are not determined by the very nature of the inquiry. It 
Des well be that the most important policy conclusion to be drawn 
Brit. much research into the political attitudes of the adults of Great 
exc ae would be that these are open to various changes. Platt, in an 
us th ent article on policy consequences of survey research, reminds 
со ~ David Donnison’s research into public attitudes towards 
avoprehensive schools demonstrated that attitudes were most 
thyoUrable where such schools already existed (Platt 1972). He drew 
co Conclusion that there was fear of the unknown, and that 1 
а Тргеһепѕіуеѕ were introduced into areas where current opinions 
uod them were running fairly high, the result would be a diminu- 
lon A the opposition. 

, Policy consequences of poll 
reflection, What Pel coulditliere r 
© People thus expressed? There are more cautious statements 
Made by the pollsters on this topic, but they relate to occasionally 

‘Sregarding ‘the will of the people’. Democratic rhetoric has 
no e so fully absorbed into the political idiom of our society that 
athos, needs to bother pointing out this aspect of po B se D^ 

Ough the newspapers occasionally report their results 1n 


on : 
Я of calling on the government to respond. 


s are not presumed to require 
be for not bowing to the will of 


e of survey results is 
a community of policy- 


ers with specific i knowing the views of a group or 
; pecific interests in. kn aie ith the popularity of 


- The success of the survey does not ) 
result as is the case with the opinion poll. M ap voy am 
citi. |S ostensibly the political authority, but 1t 5 © en 

en body whence the original opinions came. 
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wer и : ; 
ње over information in the division of labour Lg aioe 
increasingly important, and some have even argued that the Pu с 
provoked by the centrality of information-processing are SRUNI 
found that a transformation of the mode of production is a ки of 
whereas capitalist society is organised around the institu rl 
private property, post-industrial Society is held to be n. This 
round the axial principle of theoretical knowledge (Bell 19 ue still 
extreme assertion is untenable; the value of knowledge itself is de 
only finally realised through the production and sale of iit 
modity. None the less, it is increasingly the case that those who e 
privately own information about Society potentially gain ma 


A M з ‘tuations 
advantages of increased control over individuals and situation 
(Hopkins 1973). Survey-based 


Market research holds a c 
capital in most advanced capit 
decision to produce and the d 
the need of the producer to col 
buying habits of the potential 


И пн it is а 
n and distribution. At any rate, it 


ic 
e of its own, both popular and academ 
(forexample, Packard 1957; Williams 1976). 


ket 
here are, however, less widely known features of modern mar 
research. In the words of 


Leo Burnett, ‘Proliferation of brands b 
mergers have brought on a growing need for corporate am is 
о brand can be given the support it needs, and corporate ident! ste 
есопипе more important as a seal of approval' (cited in bur 

1972). In order to know how to present itself to various publics, 
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research must be done into how the relevant publics view the 
corporation. These include consumers, shareholders, the City, 
opinion leaders, potential employees, the local community, 
suppliers, the ‘trade’ and employees (Worcester 1972). The purpose 
of such research is not just to plan the advertising but also to give 
general guidelines on how the organisation that sponsored the 
research should behave towards the various publics – in how to 
handle employee relations, on what to say in public pronounce- 
ments of the company, on how to present something to the share- 
holders, and so on. The aim is not to put into practice whatever the 
relevant publics say they think is or should be the case, but usually to 
influence the public's views in some way or another. M. 
Corporate image research is conducted regularly in Britain; MORI 
and ORC have pioneered these techniques, but other market 
research companies now also do this style of research. Several major 
International corporations sponsor cross-national surveys to 
monitor the visibility of their products and attitudes towards their 
company image. Moreover, some surveys in the USA have recently 
been concerned with attitudes towards corporate profits in general, 
Without specifically concentrating on the image of one particular 
company; from time to time, for example, Union Carbide sounds out 
the American people's attitudes towards profits, company taxation 
and government regulation of industry. The kind of money required 
to do this research and to mount the subsequent advertising 
campaign is not the kind of money available to most groups in 
Society. It is important for people to know that large corporations are 
using their money not just to try to sell their products, which ua 
One is aware that they do, and has grown rather cynical about, but 


also to defend i itical ima es, programmes and positions. 
Spe Se li =i on to aid decision-making 


, The creation of survey-based informati s 
I$ not restricted to патио and distribution, but has aUe 
Such areas as jury selection. The principle of'trial by detis i h 
twelve citizens should be invested with the responsibilit L None 
ng evidence of an accused's innocence ог guilt. As the pur ipid 
Citizenship have been extended to include women as Ue 
Propertyless as well as propertied, non-tax- payer a 1 w these 
Payers, so the pressure has built up on the legal span R he cter’ 
Oundaries in once more, to exclude those of пете ec has 
Ystematic vetting of jurors in certam types O ки Већи 
come routine (Thompson 1980). Now. papier: кин ir right to 
Used by parties to litigation to enable them to pet s A te 
contest jurors in the most effective way they can, and to try 
"Deal of various lines of arguments. Eli Lilley, was sued for 


In a civil case i an 
se in the USA, a drug company; 
Marketing a drug which had been taken during pregnancy by women 


130 THE SURVEY METHOD 


А " jority of the female 
ith a history of spontaneous abortion. A majori ervical 
рее of such pregnancies subsequently deinen ic e 2 
cancer. Eli Lilley commissioned Seasonwein Associa with a view to 
survey to discover whether a jury was likely to Reque, If the matter 
deciding whether it should settle out of court or ea f individuals 
reached court, the company had a profile of the kind o contesta- 
who were most likely to acquit, so that it could сеза a dry 
tions in the most effective manner, and it also gave the de sway the 
run of the kind of arguments that were most likely ~ себ 
opinions ofthe jury. This research has to try to simulate t wor to test 
attitude formation accurately, so detailed questions are pem Wate 
respondents’ reactions to alternative points of view. (Eli entest- 
forced to pay heavy damages in the end.) Researched ae ft-wing 
tions have become so widespread in the USA that a group 0 т n how 
activists have compiled а manual which goes into full detai C vists 
to do this kind of research (Shapley 1974). It tells those yes 
worried about the morality of such research that they can rest hat по! 
that the other side аге doing exactly the same thing, and t 
doing it would be to start witha disadvantage. rch in 
Another interesting development in the use of survey resea cilia- 
the legal sphere has been the enjoinment of the Advisory, orton 
tion and Arbitration Service under the 1975 Employment Prot blish- 
Act to discover the true opinions of the employees of any esta ја be 
ment where there is a dispute about whether a union S нане 
recognised. This statutory provision for testing opinion has br ould 
with it the inevitable legal commentary on how such opinion E. te 
be sounded, since management in more than one such ae - 
challenged the results of the surveys done by ACAS on various 
nical and quasi 


er 
1981) -technical grounds (Reeves 1979, Reeves and Harp 


There was a sampling problem, 
Grunwick’s Photographic processin 
management would not allow ACAS 
than those still emplo 


å ; e at 
if you like, in a one B 
g laboratories, becaus 


" . B e 
involving an insurance company and ASTMS, the manage d 
hired an opinion polling firm to give expert evidence which claim 

. 1 aus’ 
simply because that was the first option on the list, or iod 
ASTMS was the only union mentioned by name. Methodo 

. . 1 0 1 
Wilkinson ended up having to rule about the likely existence OF e 
existence of su fi rml 
earch company acting for management (MORD j 

over the knuckles for mispresentation oftheir evidence. 


i tion 

that the employees could well have voted for union representa 
à wne- 

problems in these surveys are hotly contested. Judge Bro 

ch effects in surveys (Reeves 1979, Appendix 3), 

Tapped the res 

: 2 ively 

any different quasi-governmental and public bodies are асі 


POLITICAL APPLICATIONS OF SURVEY RESEARCH 131 


engaged in survey activities of various kinds, and this is not always the 
traditional welfare state research investigating the physical and moral 
Ран и of the people. Before the 1975 referendum about whether 
= ain should remain a member of the European Economic Com- 
Palle, some rather careful research was done by National Opinion 
im T the effect of different ways of wording the final referendum: 
infe abie 6.1. These findings are of course consistent with many 
Восе аи, They might reflect a deep trust on the part of the 
et people for the recommendations of their government. Orthe 
fact а in percentages depending on wording could reflect the 
feel; at this is an issue on which the British people did not have deep 
ie ngs at the time. A scientist would wish to explore the differences 
É Ty to gain further insight into public opinion. A politician might 
aw rather different conclusions! 


Table6.1 Wording Effects in EEC Referendum 


Difference between % Pro and % Anti among Intending Voters 


va you accept the government's recommendation that the United 402 
ingdom should come out ofthe Common Market? и 
Should the United Kingdom come out of the Common Market? е 2 
Should the United Kingdom stay in the Common Market? pia 
Do you accept the government’s recommendations that the United ied 
ingdom should stay in the Common Market? | 
E, government recommends the acceptance ante nes 
erms of British membership of the Common Market. 510 +112 
nited Kingdom stay in the Common Market? е 
. [ris i 5 
bed Majesty's government believes that the nation opens T 
б Ould be served by accepting the favourably negotiate 1d the United 
cntinued membership of the Common arket. Shou 4162 
ngdom stay in the Common Market? 
Source: Butlerand Kitzinger 1976: 60. 
. spent over 
It has been estimated that the Britain into Europi me srs about 
the x on surveys exploring in dept the eic their anxieties 
EC, and the way in which they were р keteers had neither 


(Butler and Kitzinger 1976: 257-8). The anti Ma e disposal, and it 
"ee Same resources nor equivalent expertis? iie i 
acm Not until they were assured of à mms When they did, all 
the Paign that they were able to do any resea hich merely confirmed 


Y could aff i eys, № 
the afford were four quick surveys: ted. 
heir gloomy impression ates were going to be defea 


132 THE SURVEY METHOD 


PEE ; i of 

It could be argued that the political issues raised Sb ae 
survey research are just microcosms ofthe issues raise (en ihe 
ential access to power and wealth in society. Those г наа 
money аге denied access to many survey de vam We may 
denied the possibility of gaining this powerful know! uad соне. 
have grown inured, as а society, to inequalities wa E Eni 
to the point where we treat them as natural. Bu Ремета now 
difference with information: the private ownership о! nity, These 
ledge offends against the values of the scientific е ЕЕ 
values, to be sure, demand recognition of originality, bu ‘ate, often 
are largely symbolic. To the extent that this research is privé E 
covert and not intended for wider circulation, ОА Ке 
raised. The demands for Privacy and confidentiality are in edem 
as a response to the ‘information explosion', and must be ew in the 
the demand for more Open access to information which is us 
publicarena (albeit with proper individual safeguards). 


Ideological Manipulation med 
However, it is not the abuse of powerful knowledge that has for 

the basis of many sociolo; 

Surveys offer for increased 
debate has fallen behind o 


utin 

ique. CY can legitimately be called manipulative. 

t € Second, ideological sense. osals [0 
consider the following рој, In July 1978, when prop 


the 
vhen n, 
ural land were under public discussio g the 


They 


:< of this 

als. The question asked which formed the ban oitan 

report was: ‘How strongly do you agree or disagree that 1928 owned? 
sricultural land should be privately OW" 


; ап 
ciety’ if it is not dating = than 
ey itself, we discover nts We 
ent’s proposals. Responde 
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also asked many other questions. They were asked, for example, if 
they thought that private ownership of land puts owners in a more 
privileged position; more than one-half agreed and less than one- 
third disagreed. These results were not reported. (For other examples, 
see King 1979.) 

This raises an entirely separate set of ethical and political questions 
which are peculiar to opinion polling. While appearing to be highly 
scientific, objective findings, in fact these polls can be the rich 
person's petition. The function of these hypostatised representations 
of ‘public opinion’ is not to reflect that opinion, but to intervene as a 
lobby into the political process. Later in this chapter I shall discuss 
the real targets of this lobbying; they may appear to be figures in 
authority, but instead it is more often the ‘general public’ itself that is 
the intended audience, and polling is part ofan attempt to construct a 
social consensus. 


Methodological Weaknesses of Opinion Polling 
The distinction made above between a survey and an opinion poll 
was not made on technical or methodological grounds; it was a dis- 
tinction between functions. The journalistic function of polling does 
lead, however, to some important methodological ramifications. 
Reliability and validity of the instruments of research are central 
questions for anyone wishing to treat the results scientifically, and for 
this reason sociologists and social psychologists have been very chary 
of the interpretation to be put on the answers to single-item 
questions. Indeed, McNemar argued as long ago as 1946 that they 
should be abandoned in favour of multiple items which could be 
demonstrated to forma scale, although it must be conceded that there 
has been too little attention paid to the fundamental measurement 
issues involved in the development of scaling techniques. Single-item 
Measures are often volatile, low in test-retest reliability and suscept- 
ible to minor changes in wording, as we saw 1n, Chapter 3. But their 
very volatility makes them more open to manipulation by pressure 
groups seeking to find a form of words which wi enact ee 
Normative consensus to be on its side. In the example above of the 
Country Landowners’ poll, the fact that the word ‘free’ exercises a 
pull of its own in a question enabled them to present these scientistic 


Tepresentations of the public mood. И M 
One can delimit contributory factors to the high volatility of these 


Single i ini by asking three questions: 
МЕ не e lable to the respondent? Many 


How much information is avat é 
researchers have TRH that respondents’ knowledge of the oralen 
workings of the formal political machinery варен be 
Only one-half of the electors in this country can name their (Vit, an 
only around one-fifth know where he or she stands on various issues 
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lude from this 
and Stokes 1974: 355). One should not conc ; 
eer Sx electorate is stupid. Дејн when > oe Veber 
isions, what really counts is an 5 pa і : od 
seien majority of people know what party their SUR deat я" 
None the less, it does mean that asking people detai н Р 
about aspects of the machinery, the personnel (0 и 
legislation, almost certainly produces over-crystal ise A 
which would never have been voiced outside the E cda d ii 
People find it hard to admit that they do not have knowlec dn a 
the workings of the political system, and so will give opin 


i ject 
various topics even though they have little knowledge of the subj 
under discussion. 


Act (Payne 1951) have n 
Americans risked an opini: 
Affairs Act 1975 ( 
of people who gi 
higher when a no- 
conclude that, in 
respondents’ vie 
instances where the inclusion of a ‘do 


question to asking them 
sistent 15-20 per cent of 
it, but on the oth 
Presser 1978). Th 


h to 
War. The only conclusion that it is possible е 
draw from findings of this kind is that people are responding voke, 
words ‘allow’ and * orbid’, and the connotations that they € гасу. 
rather than the more central idea of speeches against democ 
Attitudes about ‘allowing’ i 
attitudes about ‘spe 
(3) How intens 
question most fre 
opinion cannot r Presser 
individual opinions. It is not easily resolvable. Schumann and in the 
(1978) tried to account for the gap between public opion " ic 
USA on gun control which is strongly in favour and legislanon e e 
15 permissive, by lookingat the intensity with which i ecd anti- 
their views; one explanatory hypothesis argued is that the 


> This is the 
ely does the respondent feel about this? This! lic 
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Tegistration group held their views much more strongly and this had 
more influence over legislators. Ironically they discovered that ifthey 
measured intensity on a traditional Likert scale, asking people how 
strongly they felt on a 0—5 scale, the registration proponents seemed 
to feel more strongly. However, if they asked whether gun control 
would be an issue on which respondents would choose candidates in 
an election, it was the views of the anti-registration group which 
seemed more intense. 

The moral of this story is that we have a long way to go before we 
can claim to have understood anything but the most elementary facts 
about question-wording effects. A good deal of ad hoc evidence is 
being collected, but few general rules have been forthcoming. Even 
purpose-built studies to investigate the effects ofa specific problem in 
question-wording are often inconclusive. Despite intensive research, 
No general rules are available about which method of administration 
of questions — personal interview, telephone, or self-completion 
survey ~ is best for threatening questions; the results are even specific 
to the type of threat (Bradburn, Sudman etal. 1979). . 

Polls produce unsatisfactory and inconsistent evidence on key 
topics, due to over-reliance on single-item attitude measurement. 

his issue of precisely how items should be grouped together to 
search for dimensionality inherent in them is one of lively academic 
debate; I do not wish to give the impression that the difficult technical 
and conceptual issues in the construction and interpretation of scales 
d Martin forthcoming, Ch. 3). 
Opinion polls, however, do not attempt to tackle them. These single- 
; п ke better headlines and their 
d around to support a specific point 
of view. These volatile answers to weak and unvalidated questions 
are then treated as vox populi and a place is claimed for them Ium 
Political process which ignores all the conceptual and technica 
difficulties involved in their production and use. 


Marginals are more easily pushe 


Opinion Polli 3 
ing and Democracy = sni i 
€ claims that have been made for political opinion lies pave 
Not been modest. George Gallup has said that the modern po can, 
and to a certain extent does, function as a creative ep on 
Eg qu вера s quem as ел (Gallup. 1972 
Ivalent of e in the govern "eal 
a vote of confidenc horitative work on political 


overnment, \ 
the opinion of the general 


port (for example Webb 
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1980). There is general support among British pollsters for Irving 
Crespi's contention that such polls act as ‘continuing election’ and 
for Gallup’s observations that they allow a ‘bright and devastating 
light [to beam] on the gap which too often exists between the will of 
the electorate and the translation of this will into law by legislators 
(both cited in Roll and Cantril 1972). 

These views have not been without critics. The criticisms have, 
however, been of two very distinct, perhaps even opposite, types. The 
first we may call the elitist view, for, while it is correct in its analysis 
that the activity of public opinion polling leads to propaganda efforts 
‘to shape the very opinion that is being so assiduously courted’ 
(Nisbet 1975: 166), its main criticism is that true ‘public opinion 
which can express the common interest of a community can never be 
reduced to the shallow aggregate of crowd belief ‘rooted in fashion 07 
fad, and subject to caprice and whim’ (Nisbet 1975: 68). There is 4 
long history to this point of view. It was perhaps first forcefully 
expressed by Burke in his famous speech to the Bristol electors where 
he outlined the importance of representative democracy as oppose 
to popular control but one can see the same themes in The 
Vn dnd de Tocqueville, in Bryce and in many twentieth 

ury political commentators. What drives these arguments 15 5 


et of democracy and democratic principles leading to ‘mob TU Ee 
ee itis claimed, cannot decide what is in their corporate bes 
s. 


Wasa аи for Nisbet and for others before him, isto distinguit 
i oe € popular opinion of the mob from the public opinion 0 
bee len [sic]... agreed on the ends and aims of government MT 
+ he pM by which those ends shall be attained’ (Lowri 
Skane uas 1975: 185). Public opinion is thus often, (n 
ee = from legislative outcome; ifa law is passed prohibit > 
me vat is deemed as evidence that public opinion has orn 
ар 15 topic. Making this spurious and elitist distincto 
ees d people and the people as a corporate nation v ) 
а at the interests of the corporate nation are, I wonder. 
» however, have the effect of turning these eighteenth-century 


Tories against the democratic claims ofopinion polls. One can ассері 


the conclusions withou i itist vi i И 
5 t buying the elitist view of the impossibility 
less manipulable forms ofexpre Mise 


é Xpression of ‘popular’ interest. ? 
mL es X aatend objection to reading public opinion directly 
bee aquae i icopinion is aptly named, for it refers to a climate а 
ен e views thatare in the air at any one time, the subject. 
S Em. [des people in public places, and usually the foc я 
im x s ` 1s not some metaphysical entity which is latent 3 
mie + = оду public until expressed by legislative decision. 15 
> 10 do with what is being talked about; understanding the 


POLITICAL APPLICATIONS OF SURVEY RESEARCH 137 


dynamics of public opinion formation involves understanding pres- 
sures on people to speak or to stay silent (Noelle-Neumann 1979). 
Public opinion polls can connect with those currents of opinion by 
asking questions which will reveal the dimensions and structure of 
the debate, but they can also shoot questions off into the void which 
fail to relate to any real issue of current concern (Starr 1978). The fact 
that you manage to persuade a sample of a thousand or so respon- 
dents to give an answer to a question which you dream up is no 
evidence that public opinion exists on that topic. This second 
approach to the concept of public opinion has the great advantage 
that it allows a critical comparison of public opinion and legislative 
Outcome, and is an important part of the conceptual apparatus of 
democracy. Yet it is distinct from, and permits criticism of, the 
Populist rhetoric of the pollsters who wish to claim the right to speak 
on behalf of the public on the basis of the marginal responses to 
Single-item questions. , 
There is, however, a twist to this second conception of public 
Opinion and public opinion formation. What determines the issues 
on the agenda for public debate and the terms in which these issues 
are phrased? The media in general and polls in particular have an 
important role to play in the dynamic process of opinion formation; 
the polls themselves generate (often pseudo-) information about 
issues of public concern and can create the impression of acceptance 
Of particular ways of framing these issues. They are therefore 
important topics of study in their own right for political scientists 
Who want to understand the dynamics of the politics of Western 
Societies: it is scandalous that the polling industry, its structure and 
finance, has never been the object of serious academic study. 7 
The pollsters themselves hotly repudiate any suggestion that the 


Publicatio a tGndines’ itself exercises any influence over 
alc fheir ли rot ch! Their repudiation takes 


People — methinks test too mu : 
‘Wo lines е first approach is to set up а hypothesis 
that this influence would take the form of a тапар ei 
might decide their position on a debate under pressure mere y ~ 
Conform with majority opinion. This thesis is relatively easy to knoc 


ish i iments that 
ie sh it. The experimen 
eges prece 2 ave been extremely crude 


nave been con it, however, h tre P 
Intheir Miseni a prs ees perception of majority opm 
le fact that a single poll result, uttered one ien ne rage 
Opinion question, fails to alter responses. does not pe 
Same polls do not have a glacial effect oer tme. bandwagon thesis 
he most frequently cited ‘refutation of the ас t can know 
relates to voting in the USA where late voters 1n the sere No study 
€ results of voting in the East before they cast char rly returnsin 
as ever shown that these late voters are influenced y early 
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perceived majority view in much social i Asch 
: Mi : psychological research (Asc 
1951; Milgram 1961), the evidence of persuasion from mass media 
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Noelle-Neumann’s name stands out. She has advanced a dynamic 
theory of public opinion formation which rests crucially on an 
argument about which views get spoken and which views remain 
silent; her term for this process is a ‘spiral of silence’ (Noelle- 
Neumann 1974) because, she hypothesises, once a view is perceived 
as being a minority position, especially if it is viewed as declining in 
popularity, then its advocates will remain silent, thus reinforcing the 
Perception of the majority consensus. For example, she looks at some 
survey data relating to the perceived trend towards socialism in the 
Federal Republic of Germany, and asks people, not just whether they 
think it is happening, but also whether they think it constitutes 
Progress or a danger. She obtains a measure of willingness to speak 
about the subject matter by asking respondents if they would discuss 
this matter with other passengers on a train; the results are shown in 
Table 6.2. Those who perceive it as progress can be termed members 
of a winning faction, and those who perceive it as a danger can be 
termed members ofthe losing faction. Table 6.2 shows that the losing 
faction are the majority (388/229), but that if you went by what 
People said on trains, the winning faction would appear to be the 
majority (121/108). (We should want to know the correlation 
between people's predictions of their behaviour on a train and their 
actual behaviour.) A word of caution though: the interview is not 
bound to provide any better an ambience for the voicing of opinions 
than the railway carriage, of course, so this research does not solvethe 
Problem of what public opinion really is; it merely indicates the truth 
ofthe insight that it is about talking and about silence, and is modified 


y different speech situations. 


Table 6.2 Willingness of People Who Believe Socialism Will Be Established 
in the FRG to Talk about It by Perception of Itas Progress ora 


Danger 
Progress Danger 
Would talk 53 2 
Would not talk 41 ~" 
Unsure 6 Ш. 
100% 100% 
(N=229) (N=388) 


Source: Noelle-Neumann 1974. 


endas rather than produce 
en n is crucially related to 


jab а has been argued, the media se 
lling activities require 


dt media ‘effects’, and if public opinio 
Ch issues receive a public airing, then po 
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much closer scrutiny than they have received in the past. Bandwagon 
effects have been something of an Aunt Sally. The role of polls in 
putting issues on the public agenda by making it appear that they are 
things about which people are currently concerned is more 
important, if much less frequently discussed. If we argue further that 
public opinion is usually concerned with those issues that divide 
societies and produce debate and dissensus, then it should be clear 
that agenda-setting goes subtly beyond the selection of the issues, but 
extends into the presentation of those issues. The vocabulary 1n 
which issues are framed often belies a partisan standpoint: do you 
refer to ‘cuts in social services’ or ‘reduction of public expenditure? 
to ‘terrorists’ or ‘freedom fighters"? to ‘defence expenditure’ or ‘arms 
expenditure’? to ‘Rhodesia’ or ‘Zimbabwe’? By judicious phrasing of 
a question you can make people appear to endorse a particular 
rhetoric. 

_ In short, one cannot dismiss polling as an amusing adjunct to 
journalism, once one accepts that the perception of majority opinion 
and the adoption of a particular political vocabulary itself plays 4 
crucial role in the very process ofopinion formation. We need to look 
at a different kind of ‘bandwagon’ hypothesis with regard to polling 
in the pressure thus invoked to talk about certain issues in certain 


ing. 


The Consequences of such activity for democracy are serious when 
the results of this procedure are adduced as evidence contesting the 
legitimacy of other voices in society to speak for a constituency: 
especially when the other ‘voices’ are the considered end-product of 
Process of debate and representation. The most powerful alternative 
voice of public opinion in Britain today is the trade union movement, 
and the most important areas of ideological conflict are wages, Wag? 
restraint, trade union rights and the various provisions of the welfare 


State. An examination of polling activities will reveal that these аге 
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Precisely the areas in which the opinion of ‘the people’ is most often 
solicited, and set against the opinions voiced by trade union leaders in 
an attempt to discredit them (see Turner and Martin, forthcoming, 
Ch. 2; for an interesting debate on this issue from a period when 
American politics were also heavily concerned with trade union rights 
and powers, see Kornhauser 1946 and following articles). 


Two Examples 
As long ago as September 1977 Margaret Thatcher, then leader of the 


Conservatives in opposition, said that ifthere was a strike threatened 
by a major union while she was Prime Minister she would treat it as a 
confrontation between that union and the people, and ‘let the people 
decide’ what should happen through a referendum or poll on the sub- 
ject (The Times, 19 September 1977). (The opinion polling machine 
soon swung into action and allowed the Daily Express to report that 
two out of three people in the country thought that this was a good 
idea!) A reasonable person might well question how she intended to 
achieve this. Such a confrontation seemed to be brewing in the 
autumn of 1980. The previous government had a long and very 
acrimonious dispute with the manual workers in the public sector, 
who put in for a pay rise which exceeded pay policy limits. (The 
unseemly position of a Labour Party making its political stand 
against an extremely poorly paid sector which contained some of its 


Most loyal supporters undoubtedly helped bring about Thatcher's 
later, when inflation was 


Success at the ballot box.) Two years i 
running at around 20 per cent per annum, the same group put in à 
claim for a 20 per cent increase to the Conservative administration; 
the symbolic importance of the challenge was very plain. They met 
With an even brusquer reply that 6 per cent was the ceiling for such 


Increases. 


There has, of course, been no referendum on the subject, but you 
; rts of opinion polls into thinking 


might have been misled by the repo ito t 
that there had been vum Opinion Research and Communication con- 
ducted a poll im early November 1980 to ask the public what it 
thought of the 6 per cent limit in the public sector, and showed that 
two-thirds of people supported the limit, or at least the headline of 
every newspaper reporting this poll suggested that this 15 what it 


Showed in dai ers on 11 November 1980; fullest 
раа I newsPAF ser examination ofthe questions 


Teportin The Times.) However, aC ninati 
1$ necessary. Two questions Were asked to elicit views on the govern- 
Ment’s pay policy for this sector. The first was: 

ghting inflation, 


e interests of fi | 1 
6% pay rise this 


The government believes that in th 
no more than a 


Local Authority workers should get 
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time. Do you agree with this view or do you think they should get 
more? 


: d 
i that there is a presumed causal link between wages an 

oun ok would not be accepted by many ола 8 s 
Jackson, Turner and Wilkinson 1 972); indeed, the governmen videly 
policies of high interest rates and increase in VAT KEV T 
thought to be responsible for current inflation. Secondly, the iin 
solution being offered to inflation (a ‘bad thing’) is reduction in 2 
authority workers’ pay. If you present only one solution to a co ^ 
monly agreed evil, it is well known that people will tend to endorse é 
Thirdly, only the government’s rationale is presented. How do ay 
suppose people would have responded if the following, structura 
identical, question had been asked: 


The public sector unions believe that the Local Authority yorker 
should get a 20% increase in pay so that they will be able to affor n 
buy the goods being produced by British industry and help stopt 3 
recession. Do you agree with this view or do you think the govern 
mentis right to try to cut their wages? 


s ? Е К г 
Finally, if you had to choose, other things being equal, whether aay 
workers should act to help win a national ‘battle’ or to ‘try to £ 
more’, what would you recommend that they do? 


5 4 : n 
The responses to the first question are given in Table 6.3. The 
respondents were asked: 


The government has said that if Local Authorities do pay mo 
than 6%, rate-payers will have to foot the extra bill. Do you t 


Local Authorities should go to rate-payers to pay extra or shoul 
they stick to the 6% pay limit? 


А 1 : el 
What a choice! The option of central government restoring the lev 


) ses 
ofthe rate Support grant, for example, is not offered. The respon 
areshown in Table 6.4. 


Table6.3 First ORAC Question on Public Sector Workers' Pay 


TU-ists — Non-TU-ists All 
Should accept 6% 46 62 56 
Should not 49 31 38 
Don’t know 5 7 6 


(Base Ns for percentages not given) 
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d i : 
le 6.4 Second ORAC Question on Public Sector Workers’ Pay 


TU-ists — Non- TU-ists All 


Ratepayers extra 27 18 
Stick to 6% 55 72 65 
Don’t know 18 11 13 


(Base Ns for percentages not given) 


esults of these two questions 
de unionists (the people the 
tation) are against the pay 
rted the poll quoted the 
f 6%’, without mention- 
his second question 
t or rate increases. 
Its showed strong 


в аге many ways in which the г 
uld be reported. A majority of the tra 
P will meet in any confron 
End Instead, every newspaper that repo 
ine ngs as showing "Two thirds in support o 
Met erpi in the Guardian and The Times) that t 
Mo re as an alternative — support 6 per cen 
baci papers repeated the verdict that these resu 
B ng for the government’s 6 per cent policy. | 
us misreporting is not the major point at 15506. These questions 
di ise the phraseology and the perspectives of only one side of the 
ispute, and the act of answering either of them commits the 


Ра seemingly to endorse the theory that wage rises are the 
ause of inflation, or to agree that the choice is public sign pay rises 
i tasked? 


Or increases in the rates. Who decides what questions get ask: 
The money for this research was put uP by a group of businessmen, 
nown as the ‘Committee for Research into Public Attitudes’, 
chaired by Lord Plowden. The press release points out that this body 
is not aligned in any party political sense, since it commissioned a 


similar series of polls during the previous Labour administration. 
has not broken along party 


However, the issue of wage control 5 
Political lines; the two basic ‘sides’ of the dispute are employers 
(including the government, the largest employer of all) and trade 
du. In this sense, this research was paid for by one mo ts 
th pute. The committee itself had no say п the precise wording o 
ese questions; it was a matter for tie professional integrity of the 
ch AC executive responsible. But presumably it did have a say s 
Olce of topic on which to ask questions of the general public. The 
ter derlines between the broad topic, the selection of issues within a 
WM the presentation of those issues and the fine detail of question- 
Ording are very indeterminate, however; one does not accuse 


RAC ofbi : : e points out that 
of bias or lincompetence when one p : 
professions teraction is the presentation of 


e p 

x result of this client-contractor ! 
Y one side ofthe case. for rath 
he fact of the matter is that different sponsors do pay for ra SP 
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oll on 
different questions to be asked. If T TUC is 2 M dud Wa 
у t have agreed to the two questi dena 
M d ted to poll ttitudes towards na 
i pollona ld 
co-operative group had wan ee a 
isati Id probably not have , anc ited 
isation of the land, it wou ee ec am 
i t have singled out for the press rele У is that 
edid ike chapter. The problem about these two di aiii: 
the ‘other side’ has not sponsored any polls which М аі pee 
with them. But there is one issue, abortion, where s НЕ TH 
been actively involved in polling activities since the ag 


ASKS : ion of 
reform the abortion law which led to the permissive legislatio 
1967. 


; ivate 
In 1980 John Corrie, MP, attempted to introduce a Pa 
Member's Bill to Parliament to amend the 1967 eat by 
the situations in which women could obtain abortions, и from 2 
lowering the maximum permitted age of foetal Eo ues Анн one 
to 20 weeks. Gallup conducted two polls for two different с аси 
for Woman’s Own, under the general advice of Colin Fran slightly 
activist in the Abortion Law Reform Association, and one 


Life, 
later for the World Federation of Doctors Who Respect odi were 
an avowedly anti-abortion group. Among the ALRA ques 

the following: 


Which ofthe following statements do youagree with: 
"The present laws on abortion are satisfactory 


make 
"The present laws on abortion should be altered to 
abortion more difficult to obtain’ 


make 
"The present laws On abortion should be altered to 
abortion easier to obtain’ 


nant, 
(women) If you had Suffered rape and as a result became preg 
do you think you would: 


1 пе preg- 
(men) If your Partner had suffered rape and asa result becan 
nant, what do you think you would prefer: 


Continue with the Pregnancy and keep the child? 
continue with the 


Pregnancy and offer the child for adoptio 
seek an abortion 


doesn’t apply to me. 


The WFDWRHL questions contained the following: 


Do you think that abortions: 
should be available on demand 


should only be allowed in certain circumstances 
should never be allowed 
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Reduci TOA 
A TN abortion from 28 weeks to 20 weeks 
abnormality of the life of the mother and serious foetal 
ies too far 
oes not go fa 
about right. о 


I con " Е 
Ена ка заћи pilot study with twenty-seven of my students and 
questions; I ask di they could judge who had sponsored the various 
by a group th ed ifthey thought that the questions had been paid for 
group that o at supported Corrie's amendment of the 1967 Act ora 
question Md a it. There was only one question (the first ALRA 
say. With this ere) where the majority said that they found it hard to 
Own questio one exception, the majority identified all the Woman 's 
and correct] ns а sponsored by a group opposed to the amendment, 
Sponsored Е”, identified every one of the WFDWRHL questions as 

y a group supporting it. (Further details will be supplied 


lean ina particular Way: the 
nsus about the direction 
th some questions), and 


reliable ; s А 
t epale identification of two different sets of questions, even though 
er had been deliberately mixed up- 
executive Ч and accuse the Gallup 
s of acting unethically, of heir professional souls 
eld the cheque-book. We have 


h for unbiased question- 
ive quest. 


answer 
s to any one of these single-item, ШП 
ds abortion ( 


t questions pr 
fair to criticise Gallup are 1n 


allow} a 

advocas WFDWRHL to present the results of their first question as 

DEW the Polling in support of the Corrie amendment, when they 

Produced questions such as the first as ed by Womans Own 
such different marginals. 


f onclusion 

sbe 

Used anions the same instruments of data collection and assembly are 

Of the f, oth surveys and polls that many have есоте as suspicious 

Sional по as they are of the latter. It should be à matter of profes- 
oncern to sociologists and other survey resear 


flaws: 
to answer i many of these political polls. The more di 
is what a political response to the growth of these ac 
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should be. Polling is only banned in those countries with very repres- 
sive political regimes (although many countries and states forbid it in 
the run-up to an election). I have discussed it as an instance of 
‘ideological manipulation’ because it is so blatantly artefactual most 
ofthe time. One effect ofthe dramatic increase in the sheer volume of 
information being generated and communicated in society at the 
moment could turn out to be not a Big Brother nightmare of central 
control and manipulation ofthe means ofinformation, but a very real 
increase in the potential for local control and decision-making; 
perhaps, under such conditions, polling will come into its own. Or, 
perhaps, the British trade union movement, like the Black movement 
in USA, may decide to join battle and set up its own polling 
companies asking questions about issues which they decide and in 
ways in which they select. This would not imply a genetic fallacy in 


their theory of knowledge, but rather a grim recognition of the 
information war’, and the reality of the interests expressed in polling 
as 1t 15 currently done. Would there be opinion polling in a socialist 
Britain? It’s an open question. 


7 


Conclusion 


—————— — ——— 


The measurement of public opinion brings together some ofthe most 
difficult issues faced at the moment in survey research. I do not wish 
to give the impression that it is impossible; there have been some 
Sophisticated studies of such things as the views of the British 
electorate towards Europe, which highlight the views of differing sub- 
groups in the population and investigate the extent to which these 
views form a coherent and patterned outlook (Jowell and Spence 
1975). And there are some issues about which most people have 
Stable and fairly consistent views; capital punishment would be an 
example of this. 
The scholarly study of these political attitudes faces many diffi- 
culties, the most severe of which are the problems of measurement. 
hould one ask open or closed questions (Schuman and Presser 
1979a)? Should respondents be asked to record general affect towards 
People or policies (the Gallup approach) or should they be asked to 
endorse higher level arguments (the Harris approach)? What models 
Should be used to measure attitude consistency (Judd and Milburn 
1980)? Should a ‘no option’ category be explicitly offered to respon- 
dents (Schuman and Presser 1979b)? Which response categories 
Should be used: yes/no; agree/disagree (Bishop et al. 1978)? What 
Causes two identical questions, asked by different research houses, to 
Produce different results and to track differently across time (Turner 
and Krauss 1978)? Can one avoid socially desirable responses 
(DeMaio 1980; Bradburn, Sudman et al. 1979)? The list of the current 
Methodological concerns of survey researchers involved in стаг. 
Ing attitudes. opinion and ideologies could be extended indefinite w 
оса! science is intimately bound up with the subjective reality o 
Social actors; social measurement, if it is to be valid, must have are 
a t better answers than it currently has to questions like the 
Ove. |. 


es Mes a lot to offer i wanes 
^. 9€ used to investigate a wide г лас: х 
“Ere is often no te ets to considering variation across van ina 
Systematic fashion. Since the processes of determination int e soci | 
“rd are subjective in important ways, involving actors’ meaning 
the intentions, the survey researcher has to face the task orien 
ese subjective aspects. It is not easy. Perhaps the most misguide 


t. Since experimentation 
f macro-social processes, 
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and damaging of all the criticisms that have been made of survey 
research was C. W. Mills’s contention that their design and 
implementation involved no sociological imagination, but only the 
mechanical skills of techniques following time-honoured formulae. 
Nor are surveys cheap. Because of the ever-present danger of faulty 
inference from correlational data, measurements of all the possible 
confounding variables must be made, and the sample size must be 
large enough to ensure adequate representation of cases the subcells 
created in analysis. 

The survey method is a tool. Like any tool, it is open to misuse. It 
can be used in providing evidence for sociological arguments or, as in 
any aspect of sociology, it can be used for ideological constructions. 
Surveys are expensive, so it tends to be people with power and 


resources who have used them most heavily. But none of this justifies 
their neglect by sociologists. 


Note: Chapter 7 


| AUS National Academy of Sciences panel is reviewing the whole range of errors 
associated with survey-based measures of subjective phenomena. Two volumes will 
be forthcoming as a result of these deliberations, a report and a collection of papers 
addressed to specific problems (Turner and Martin forthcoming). 
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Cambrid R. M. and Beynon, H. 1972 Perceptions of Work, Cambridge: 
Blackburn pe Uiyersity Press. 93 
Market, Lor M. and Mann, M. 1979 The Working 
Blalock London: Macmillan. 77, 110 
American M. 1961 ‘Evaluating the 
а а Review, 26, D 
Sinnen. e EUR Straightforwa 
76 eous equation systems, and по 
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866-74. Reprinted in 


ecember, РР. 9. e 
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tion of direct and indirect effects. 


ions of analysis’, American 


Bian p 
[neis 1957 ‘Formal organisations: dimens 
Blumer tia sociology, 63, pp. 58-69. 60,61 UNT 
Review | 1954 *What is wrong with social theory? can Sociological 
Blume 19; PP. 3-10.55 
logical R 1956 ‘Sociological analysis and the Var! 
eview, 21, pp. 683-90. 55 
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Blumler, J. G. 1977 ‘The intervention of television in British iso 
Appendix E of the Annan Report on Broadcasting. An S vede 
overview of broadcasting research. Despite the non-findings oft в 
years, the idea that the media of LS communication have ап е 

le is open to debate once more. "m 

Board of Trade 1888 'Statements of men living in certain selected mens 
London in March 1887'. Survey based on 25,451 returns filled in c 
workmen themselves, therefore exaggerated rents and ise dite 
wages. Questions printed on large, easy-to-handle cards. Pages and P of 
tables. No conclusions from them. ‘But in order to avoid c 
mistake, I may perhaps be permitted to state that, after devoting muc iing 
and labour to a careful examination of the returns, and after p ee 
myself fully as to the conditions under which the data were collected, ru 
come to the conclusion that these returns are of very small statisti 
value.' William Ogle, Superintendent of Statistics, GRO. 19 js 

Booth, C. (ed.) 1892 Life and Labour of the People of London, Volume !: 
East, Central and South London, London: Macmillan. 18 cial 

Bowley, A. L. 1915 The Nature and Purpose of the Measurement of S0 int 
Phenomena, 2nd ed, London: P. S. King & Son. Bowley makes the P 
that you can rank things even when you cannot measure them eb 
authentic scale. He proposes definitions, classifications and measuren 
of societies and nations, place of residence, density of popular: ol 
industrial classification and employment status, degree of garam 
household, lodgers, tenants, People staying, social position, inco ing 
family, income distribution, production and consumption, standardis 
poverty line, economic progress ofa nation, GNP, and so on. 25 ian 

Bowley, A. L. and Burnett-Hurst, A. 1915 Livelihood and Poverty, Ra 


Tata Foundation, University of London. This is the famous five tow 
study. 27 


Box, J. F. 1978 R. А. Fisher: The 


Fisher Box is КАЕ daughter, and this is an excellent biography. tions 
Statistician herself, and SO is capable of combining personal reflec 
with incisive intellectual history. 41 f the 
Е мя Thomas, С. 1944 ‘The Wartime Social Survey’, Journal д 
oyal Statistical Society, Ma + pp. 151-89, yiew 
Bradburn, N. M., Sudmian, 5 ew ec 1979 Improving 1 ind 
Method and Questionnaire Design: Response Effects to (UA 
Questions in Survey Research, San Francisco: Jossey-Bass. This fthe 
collects together the reports ofa series of experiments which grew out 5 Я 
principal authors’ earlier (1974) review ofthe response effect literature. 


gical survey’, Sociological Reyin Pi 
iscussion ofthe Ordnance Survey and Pays a the 
ts still have to be mapped. ‘Socialisation rvice’ 
ey and emancipation of the scientist for human x Agri- 
urveys by mine inspectors, stock-taking of Board о 5 
culture, census of Production, surveys of slums and tenant ae y 
drainage and refuse by sanitary inspectors, of factories and workshops by 
actory and labour inspectors, of civic hygiene and schoolchildre? по 
medical inspectors, and census. Also unofficial people like Booth, bu 
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Life of a Scientist, New York: Wild isa 
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sufficient documentation of cultural aspects. Galton’s eugenic survey. 
Some are more historical. Aim of sociological survey to gather fragments of 
information and fill gaps. Approved of Geddes's approach, and his 
Suggestion of a civic museum. ‘The end of the social survey is to make us 


B see Eutopia, and seeing it, to create it.’ 27, 30, 31 P 
Town, G, W. 1981 ‘Contextual measures of life events’, in B. S. Dohrenwend 
and B. P. Dohrenwend (eds) Stressful Life Events and their Contexts, New 
York: Neale Watson. There is nothing much in this article that is not in 
Brown and Harris 1978, but it usefully collects together his views on how 
One sets about measuring contextually and the stages in building up such 
Contextual measures of the threat of life events: (1) record events 
independently of the subject's opinion of their impact; (2) collect extensive 
background information about the events; (3) use raters outside the inter; 
view situation to use their knowledge of the subject's background context 
is to measure the degree of threat. 117 i^n: d, 
Town, G. W. and Harris, T. 1978 The Social Origins of Depression: А Study 
of Psychiatric Disorder in Women, London: Tavistock. A study of the 
incidence and causation on depression in a sample MH » 
Camberwell, London. It is discussed fully in Chapter 3 ofthis eoi 
monem inheritor of the Durkheimian tradition с аня analysis. See 
ennant and Bebbington 1978 fora critique. 55,111- : 
Bulmer, M. (ed.) 1975 Working Class Images of Society, London: peer d 
Direct Editions. Reprints Lockwood's “Sources of variation nae бе 
Class images of society’ of 1966 and a series of articles documenting 


in ry research that this has given rise to. T 
er, M. 1981 ‘Sociology and political science 27, 5 e 
ап opportunity missed and an opportunity taken’, Cambridge Renet a 
April, pp. 156-9. He looks at the failure of Cambridge ae ка 
Memorial tones n 15205, pef p p was the poor 
Memorial was made available for that purpose that the opportunity 
academic standing of sociology in Britain at the time d] 
Was passed by, although a chair in political science was e npa 
Burgess, E. W. 1916 ‘The social survey: à field r ron pese a 
departments of sociology’. American Journal of oci ogy what early 
Pe RL a isa very E oe Pio The ‘sociologist’ is the 
Merican social surveyors thought they were up nn j: 
football coach for a vast army of local ona E 
Conditions and then propose remedies. A so 
B Darwinism. 31 M 
"Mer, D. and Kitzinger, U- 1976 The 1 
acmillan Chapter 10 is on the polls reis 
utler, D. and Stokes, D. 1974 Political Change in d adi LA tue 
Electoral Choice. 2nd edn, London: Macmillan. д fp tore Над ju 
example of British survey research. which ев 1957, 111, 134 
redd Мини“ ма мо“ 5 а Experimental and pi 
pbell, D. T. and Stanley, ^. ~ _ Exper nd. McNally, Рр. 
[perimental Designs for Research, Chicago: | 
H 7 vices: iminary 
Sonat A: 19:3 рари and Educational Баа тед ) 
Report опа Social Survey, Geneva: UNESCO (rel- 
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À ers, A. M. 1934 ‘Problems of regional survey’, Public 
тата XII (1), January, pp. 47-52. Usual definition of a vie 
as (a) factual, (5) to assist social reform. He is clearly concerned not to have 
a mass of community surveys queering his pitch, and suggests they use 
extant material, leaving the big problems for the professionals. 30 
Carr-Saunders, A. M. and Jones, D. C. 1937 А Survey ofthe Se pie 
of England and Wales, 2nd edn (Ist edn 1927). This is a statistical abstrac 
of contemporary social data from the *morphological point of view'. It is 
rather like an early ‘Social trends’, with chapters on population by age, sex, 
marriage, housing, region, industry, occupation, on industrial status ue 
class, trade unions, religious organisations, the national income, nationa 
wealth, job-seeking and unemployment, state pensions, public services, 
taxes, friendly societies, charity, poverty, crime, intelligence and fertility. 
But it is quite ‘readable’ – giving an ‘account’ in each chapter. 30 у 
Cicourel, А. У. 1964 Method and Measurement in Sociology, Glencoe, Ill.: 
Free Press. 53-4, 58-62, 117 ial 
Clapham Report 1946 Report of the Committee on the Provision for SOCH 
and Economic Research, London: HMSO, Cmd 6868, July. Complains 9 
under-financing and under-institutionalising ofsocial research in UK. : 
Cobbett, W. 1975 Rural Rides London: Macdonald Facsimile Edition. First 
published London 1830, 12 


Cohen, Р. 1980 ‘Is positivism dead?’, Sociological Review, 28 (1), рр. 141-76. 
3 


Cole, S. 1972 "Continuity and institutionalisation in science: a case study id 
failure’, in Oberschall 1972, pp. 73-129. Reprinted in Lazarsfeld e dl. 
1972. There was good research around in the mid-nineteenth century de 
cites a monograph by Plint as an example) but, for a variety of reasons, t 
skills were not institutionalised and were therefore lost. 15 ee ith 

Coleman, J. $. 1959 ‘Relational analysis: a study of social organisation №! d 
Survey methods', Human Organisation, 17, 1958-9, pp. 28-36. Hep 
in Lazarsfeld 1972. The earliest use by sociologists of survey methods ke B 
the study of single-variable distributions, often taken from opinion po of 
where the unit was an atomised, independent individual. Slowly the ар 
analytical Surveys, explaining patterns, developed, and other possibiliti 
began to be revealed, Sampling strategies available are snowball samp! A 
saturation sampling, dense sampling and multistage sampling. Analyti ol 
methods available are contextual analysis, search for the boundaries 
homogeneity, pair analysis and partitioning into cliques. 61 , tion 

Coleman, J. S., Katz, E. and Menzel, H. 1957 ‘The diffusion ofan innovat 
among physicians’, Sociometry, 20, pp. 253-70. 61 1848 

Committee Investigating the Poorer Classes in St Georges in the East the- 
‘Investigations into the state of the poorer classes in St George eG od 
East’, Journal of the Statistical Society of London, 11. pp. 193-250. 22 
because comparable area covered in Board of Trade 1887 inquiry. 19- D. 

Converse, P. E, 1964 ‘The nature of belief systems in mass publics, НР 
rgd me Ideology and Discontent, New York: Free Press, pp. 206 

Cullen, M. 1975 The Statistical Movement in early Victorian Britain. 2 
Foundations of Empirical Social Research, Hassocks, Sussex: Haee 
Press. The best available Source on the early Victorian statistical societies: 
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an excellent account of the statistical activities of the government. 14, 
C В 
pagrecrnigg ger M. and Wollacott, J. (eds) 1977 Mass Communication 
Uni ociety, London: Edward Arnold in association with the Open 
gd Press. In reaction to the ‘who says what, how, to whom and with 
jon B wol eA кея nape try to ask, broader questions of the 
d'Andrade, R. D. 1 ura го е of the media in society. 138 Р : 
Blalock 1974, | 974 ‘Memory and the assessment of behaviour, in 
patterned но pp. 159-86. Shows how memory distortions may be 
Biche = such a way that investigators may obtain a totally erroneous 
eh oft e interrelationships among behaviour dimensions, even where 
David Ty pertains to very recent events. 82 
son, D. 1963 ‘Actions, reasons and causes’, Journa 
D pp. 685-99, 52 
NE & A. 1971 Elementary Survey Analysis, Englewood Cliffs, 
sen rentice-Hall. Excellent account of the procedures of survey 
Davis th but unfortunately in terms of decomposing gamma, which 
critici imself subsequently has admitted is not ideal. The appendix 
45 а decomposition formula of Lazarsfeld and Kendall of 1950. 
3 J. A. 1976 ‘Analyzing conting 
н , in D. Heise (ed.), Sociologica 
shesey-Bass, pp. 111-45. Expands domain of causal diagrams to cover 
R analysis of categorical variables, thereby increasing the heuristic, 
aposilory and pedagogical flexibility of researchers working with 
ана variates. Lays particular stress ОП developing diagrams that 
cr orm to rules of flow-graph analysis. Concentrates on models for 
со зеспопа! data апа gives explicit attention to issues of estimation 
avis C significance. 73, 75. 
NORCG, 1979 ‘Background variabl 
General Social Surveys: ten 8€ 


lof Philosophy, 60, 


ency tables with linear flow graphs: 
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: i i " fa. 
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sid Independent variables, and comes ир with some ори НЕҢ 
аве Mating general conclusions about the average effects cae t mS 
fuente religion, education, occupation, and so on. ThE нша eu 
Mer mre these results are generalisable beyond Ge 
2 „103,111 

u : ^ n2 
Ма 1970 ‘The two sociologies’. British Journal of Sociology Зеу 
ment, th 207-18. Classic article tracing two Pro Jems from T e и 
Probi, the orthodox problem of order, ап the enoli m 
fundis of control. Sociology is à result of the mu d ciem 
~ Mentally opposed social philosophies which addr 


DeMaio 
Surve 


cial desirability measures 1n 


ek J. (forthcoming) ‘A review of 506: 
in Turnerand Martin (eds.) forthcoming VO T 


156 THE SURVEY METHOD 


Duncan, O. D. 1973 Introduction to Structural Equation Models, London: 
Academic Press. 73 
Duncan, O. D. 1979 ‘Indicators of sex typing: traditional and egalitarian, 
situational and ideological’, American Journal of Sociology, 85 (2), PP- 
251-60. Analyses responses from 1953 to 1976 of mothers to question 
about sex-typing of household chores. It is of strong methodological 
interest, because it proposes model of scale types that have been derived 
theoretically. One dimension of traditional/egalitarian responses is not 
enough, but an additional dimension of whether the rationale behind the 
responses is ideological or situational provides a model that fits well — it 
Pays special attention to the consistently traditional and consistently 
egalitarian responses. 73 
Easthope, G. 1974 A History of Social Research Methods, London: 
Longman. Very disappointing, given the dearth of books on this subject. A 
is organised by ‘method’, with a chapter on the origins of sociology which 
amely suggests that the motivating forces among sociologists were a drive, 
йа Scientific and compassionate. The chapters on the history о 
=. ys methods are examples strung together. 16 
re 838 Journal of the Statistical Society of London, 1 (1). Мау. U^ 
| епсе d Statistics is descriptive, not explanatory. It is connected wit 
PELA y, geology, agriculture, zoology and botany, and even chemistry» 
Bleek D dno tec No speculation is permitted. 38 f dis- 
continuity inth е Manchester Statistical Society: a case study © 972 
pp. 31-72 His history of empirical social research’, in Oberschall 19 en 
demonstrati 'storical article on the Manchester Statistical seed for 
inure ed knowledge of precoding, percentages and the nee t 
later dateien ut these gains were not consolidated and often work best 
oa ine ig than Work at an earlier date. Again, the technically lar 
channels of. Fani Failed to institutionalise work. Did not establish на 
аи communication, did not mention each other's work, did n t 
stage of ge Tesearch (except perhaps in question-asking); did not 8 ree 
nd ~ nerating their own problems, Why? Because they could not e 
diversified i goals, for example, place of education vis à vis religion. ern- 
strass eei money and manpower to other causes. The MAE 
Aper i o develop institutions to gather statistics, the individuals Y id 
refo pted by the government. What they were really interested in was 509 
Engels, F ; 1 i om 
Personal pd The Condition of the Working Class in England fr i 
QD риает ат Authentic Sources, London: Panther 
Peking: oe Anti-Duhring: Herr Eugen Duhring’s Revolution in Sciences 
Everitt, B. S & br Pm rg Press. First published in 1878. 75 ples: а 
brief discu nd Smith, A. M. R. 1979 ‘Interactions in contingency a рр: 
3 Бо of alternative definitions’, Psychological Medicine. "^ 


The Life and Times of Sir Edwin Chadwick. London 

таи New York: Barnes & ls A good way in to the kinds © 
Fischoff B Sed intellectual concerns ofthe time. 14 

Mica lavig, P. and Lichtenstein, S. 1979 ‘Knowing what you 

8 labile values’, in T. Wallsten (ed.), Cognitive Proces. 


Finer, $, E. 1952 
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Choice and Decision Behaviour, Hillsdale, NJ: Erlbaum, pp. 117-41. 
People’s values are contradictory, incoherent and open to biased elicita- 
tion or even creation by questioning. If all we are interested in is how 
People express themselves, then this may not be so bad. But if we are 
Concerned democratically with what people value and why, we need much 
finer conceptual elaboration, better questions and a dialectical eliciting 
Bere cure which acknowledges the roles of the interviewer. (No data.) 111 
isher, R. A. 1925 Statistical Methods for Research Workers, Edinburgh: 
Oliver & Boyd. New editions in 1928, 1930, 1932, 1934, 1936, 1938, 1941, 
Б sing 1946, 1950, 1954, 1958 апа 1970. 41,42 
isher, R. A. 1935 The Design of Experiments, Edinburgh: Oliver & Boyd. 
F New editions in 1937, 1942, 1947, 1949, 1951, 1960 and 1966. 41 
oster, J. 1974 Class Struggle in the Industrial Revolution, London: 
5 Weidenfeld & Nicolson. 12 
Othergill, J. E. and Willcock, H. D. 1953 ‘Interviewers and interviewing’, 
Social Survey Papers, Methodological Series, Paper No. M. 69. Historical 
account of development of interviewing; two mistakes were common: (1) 
Concentration on comprehension of question without adequate reference 
"e how it was comprehended; (2) concentration of formal design. of 
Questions. People were more concerned with the adequacy ofthe question 
than the adequacy of responses. Move from multidimensional to uni- 
dimensional questions, to more structured questions and more factual 
data. Changes in design have taken place to make sure that similar 
recorded responses to questions have similar meaning and are additive and 
that dimensions of responses can be identified. Separation of exploratory 
Pilot from final version. This has meant changes in interviewer's job. 
Difficulties of getting people to stay long enough in job which requires very 
diverse attributes – interviewing skills, clerical accuracy and. avail- 
ability – is discussed. Methods proposed for evaluating interviewers. 
Fratainingis essential. 34 У , р 
псоте, С. 1980 ‘Public opinion оп abortion: three polls published in 
February 1980’, Department of Sociology, Middlesex Polytechnic, 
endon, for the Abortion Law Reform Association, mimeo. He explains 
nhy three rather different questions produced such seemingly discrepant 
esults on opini ion. 144-5 me 
unkhouser, G. R1 њиве sixties’, Public Opinion Quarterly, 
37 (1), Spring, pp. 62-75. Compared importance of issues In polls with 
Prominence in quality news magazines. Mostly agreed. Discrepancies 
сате in more personal questions — views on Vietnam or race relations. But 
looking at Vietnam War, campus unrest and urban riots, did not tally with 
reality, Coverage of non-newsworthy issues Was primarily a function of 
ca heial news. 55,138 
Я Пе, D. 1978 In Search ofthe New Working Class, Ca 
riversity Press.93 —— 
VP: G. 1948 A Guide го Public Opinion 
ersity Press, Fi ublished . 1 ! 
Question d n ar *Do you approve/disapprove 5250m. aig T 
reece?” Instead: (1) Find out what person knows . - - have you Fa ? (2) 
Ask what he thinks – what do you think? (3) Then ask direct tp ae 
should Congress vote $250m.? (4) Why does person feel this way? (5) How 


mbridge: Cambridge 


Polls, Princeton, NJ: Princeton 
*Quintamensional" plan of 
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strongly does person hold this opinion? Very persuasive book extolling the 
virtues of public opinion polling in a democracy. Answers to 100 questions 
commonly asked about polls. 135 
Gallup, G. 1972 ‘Opinion polling in a democracy’, in J. Tanur et al. (eds). 
Statistics, a guide to the unknown, San Francisco: Holden Day, pp. 
146-52. The common man’s quotient of good sense is so high that there is 
nothing to worry about widespread influence of polls on decision-makers. 
135 
Galtung, J. 1967 Theory and Methods of Social Research, London: Allen & 
Unwin. 127 
Gellner, E. 1974 ‘The new idealism — cause and meaning in the social 
sciences’, in A. Giddens (ed.), Positivism and Sociology, London: 
Heinemann Educational, pp. 129-56. 52,98 
a A. 1976 New Rules of Sociological Method, London: Hutchinson. 
Glass, D. V. 1973 Numbering the People: The Eighteenth Century Popula- 
tion Controversy and the Development of Census and Vital Statistics in 
Britain, Farnborough: D. C. Heath. A rather dry but scholarly account of 
the heated debates between the ‘optimists’ and the ‘pessimists’ in 
sighteenth-century England about population change since the Glorious 
Revolution, of the introduction of the inadequate census of 1801 and the 


gradual development towards a More modern census with household 
schedules in 1841, and of the inst 


Marriages and deaths. He still does 
ment was so slow - h 


by suggesting that LePlay had contrived to appeal to deep-seated theme 
British middle class culture - a 


Glenn, N. D. 1967 ‘Massifi 


rom national surveys’, Social Forces, 46, December, pp. 172-80. H 
response to claims by Hodges, Bell and Boulding that society ма» 
„p creasingly ‘massified’, first cohort studies tried to examine the thesis. But 
this trend study рг 
Looking only at what are considered to be fairly stable values, only sex an 
urban-rural differences are declining, and regional, educational an 
occupational differences are increasing. Ambiguous evidence on social an 
religious differences. Most of the data gathered in early 1960s when 
respondents were not socialised in theeraof TV. 110 3 
Goldthorpe, J. H., Lockwood, D. et al. 1968 The Affluent Worker, Vols і. d 
Cambridge: Cambridge University Press (Vol. 2 came out in 1928, Vol. 
in 1969 and Vol. | in 1970).92, 109-10 ў 
Gough, L 1979 The Political Economy of the Welfare State, London: 
Macmillan. A bold attempt to provide an account of the state’s role " 
various areas of social welfare, and to relate the ideology and reality of it 
roleto the €conomics of ‘advanced’ capitalism. 35 ills of 
Graunt, J. 1939 Natural and Political Observations Made upon the Bills 2 
Mortality, Baltimore, Md: Johns Hopkins University Press. pus 
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i : 
Pact 166P Graunt, spurred on by the information contained in the 
AE a ity prepared in connection with the great plague, was the first 
(1968) пао demographic material in а modern statistical way. Selvin 
ИН Е егѕ that he set the pattern of statistical analysis until the 
Gray P G А with his early work on life tables. 10, 47п1 
We pe (~ опен, T. 1950 Sampling for the Social Survey’, Journal of 
Givesa flay а ed Society, pt 11, рр. 150-99 (discussion pp. 200-6). 
Griffiths D rad survey work done by government. 34 
Senor Pues J. and Miles, I. 1979 ‘Social statistics: towards a radical 
polities, E) rvine et al. 1979, pp. 339-81. An interesting review of the 
VEU о what might loosely be called ‘science and society” over the last 
SaLi o eye it argues that one must see scientific knowledge as a 
Ren product, claiming that this replaces older versions of how to appraise 
ce. The conclusion discusses the practicalities of what radical 


H i ea eg should do. 67 
ales e (ed.) 1972 Education Priority, HMSO. 66 у 
Tourno H., Hurwitz, W. N. et al. 1951 ‘Response errors In surveys’ 
eae ofthe American Statistical Association, 46 (June, pP. 147-90. The 
Harris ctreatment oferrorasa deviation from an ‘individual true value’. 56 
H son, T. 1978 Living through the Blitz, Harmondsworth: Penguin. Tom 
arrisson had virtually completed this work before his death, but it 1s 1n 
Places a bit rough. He based it on the accounts which had lain for years 
rused in Sussex’s Mass-Observation archive. This shows Mass- 
bservation at its very best, documenting a unique social situation by 
observation, diary and direct inquiry at a time when other forms of 
H investigations were both politically and practically impossible. 32, 33 
arrop, M. 1980 ‘Social research and market research: à critique of a 
Critique’, Sociology, 14 (2), PP- 277-81. Defends the practice of market 
Geri companies and complains at the low evel of most 
ein sociologists. He has an interesting teven tegies 1n 
eys reported in British sociolo. ical journals. Е 
Hauser, P. 1969 bison on Coleman's paper, in R. Bierstedt (ed.), A 
Design for Sociology: Scope, Objectives an Methods, Philadelphia, Pa: 
H merican Academy of Political and Social Science, рр. 122-8.64 N 
Kos R. M. 1970 'Context and consex: a cautionary tale’, American 
lournal of Sociology, 75, pp. 645-64. 61 
Heise, D. 1974 ERA New York: Wiley. 73 1 у 
nnock, E. P. 1976 ‘Poverty and social theory in England: the experience of 
the eighteen-cighties’, Social History; 1, January, PP- 67-91. Re- 
evaluation of Booth's contribution to late nineteenth-century thought. 
Hennock debunks many myths th, and argues that his role was as 
а Systematiser of popular conce me to separate the respectable 
from incompetent working class. There is also a description of the Select 
Committee of the House of Lo igation into the Sweated Trades, 
and the two case studies are used (0418 3 dii G Е roposed 
H in the 1880s are not innovatory but have continuity wit Enni 
спу, H. 1971 "We cannot ask why” і in H. Henry (ed.), erpen су in 
Management and Marketing Research, London: Crosby s w , PP. 
293-311. First given as a paper at а joint ESOMAR/WAP eon erence 
in 1953. A seminal paper which argues that ‘the normal human being in 


of sampling stra 
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ilisation i i lise, even to himself, what 
i ation is usually quite unable to realise, | de 
on for many of his actions’. Henry argues this on the asi; ra 
ex eid of his from product research, Um convincingly that peop 
they use particular products. 1 5- ў ЎЎ 
Hinde, pate Use of Official Statistics in POLITE A Critique of. 
‘Positivism and Ethnomethodology, London: Macmillan. 62 UAM 
Hindess, B. 1977 Philosophy and Methodology in the Social Sc 
у ks, Sussex: Harvester Press. 63 е N 
ET and Selvin, H. C. 1973 Principles of Survey Analysis: oe 
quency Research, New York: Free Press. First published as e 
Researchin 1967, and subsequently renamed. Principles of causal an 


Imperialism, big business an 
Hope, K. 1981 ‘Vertical mobilit: 
15 (1), Februar: : pp. 19-15.72 !arinnistti 
Hopkins, H. 1973 The Numbers Game: The Bland Totalitar heroes, 
London: Secker & Warburg. A rather silly book. He has four a Numbers 
Malthus, Booth, Galton and Kinsey, who began the dreaded stem on 
Game. He blames Beeching's policies to cut the British railway cong ina 
his statistical approach. Thinks public service ideal is disappea to keep 
limpish way. Figures become self-fulfilling prophecies. Med NR о 
arping on that more research is needed. Calls for new Decla 
ndependence. Need to educate people better, 128 ie’. British 
Horton, J. 1964 ‘The dehumanisation of alienation and anomie’, 
Journal of Sociology, 15 (4), pp. 283-300. 11 < Free Press: 
Hyman, H. H. 1955 Survey Design and Analysis, Glencoe, Il.: d analysis: 
Classic manual of survey research, concentrating on design an to read à 
Not interviewing, sampling and coding. Good appendix on how t well a5 
table. Designed to train a survey analyst in technical matters as of pro- 
theory. Includes questionnaires from major surveys, examples 
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ced i i i 
с [eei and illustrations. Based on practical experiences of 
Veiis gues for a distinction between descriptive and о 
a eys 45 c nas and explanatory 
man, H. H., Wright, C. К 
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Jones, R. A. and Kronus, S. 1976 ‘Professional sociologists and the E 
sociology: a survey of recent opinion', Journal of the uis d AUN 
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Judd, C. M. and Milburn, M. A. 1980 ‘Structure of attitude systems md 
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Kadushin, C. 1968 ‘Reason analysis’, in D. L. Sills (ed.), International 
Encyclopaedia of the Social Sciences, Vol. 13, New York: Macmillan sm 
Free Press, 338-43. Reason analysis is a set of procedures used ID uin. 
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me and at ways of designing, conducting and analysing such a study. 
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Kish, L. 1959 ‘Some statistical problems in research design’, American 
Sociological Review, 24, pp. 328-38. Several statistical problems in the 
design of research are discussed: (1) The use of statistical tests and the 
search for causation in survey research are examined; for this, we suggest 
separating four classes of variables: explanatory, controlled, confounded 
and randomised. (2) The relative advantages of experiments, surveys and 
other investigations are shown to derive respectively from better control, 
representation and measurement. (3) Finally, three common misuses of 
statistical tests are examined: ‘hunting with a shot-gun for significant 
differences’, confusing statistical significance with substantive significance 
and overemphasis on the primitive level of merely finding differences. 65 

Kolakowski, L. 1972 Positivist Philosophy, Harmondsworth: Penguin. 49 f 

Kornhauser, A. 1946 ‘Are public opinion polls fair to organized labor?’, 
Public Opinion Quarterly, 10, Winter, pp. 484-500 (reply by Link in 
1947). During the war US polling agencies, AIPO in particular, conducted 
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cumulative biases in these questions — biased subject matter, varieties of 
slanted wording and inadequacies of interpretation and report. Calls for 
more scientific attention to be paid to these polls, and for submission of 
Proposed questions to opposing sides for their comments. TELS "m 
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politics, interest is psychology and concern for 'explication'. Lazarsfeld 
took a degree in maths. Taught at a gymnasium and then studied 
psychology under the Buhlers in Vienna. Wrote Marienthal and then went 
to USA on a Rockefeller fellowship. At that time, US market research 
consisted of nose-counting. Joined Psychological Corporation. Got 
interested in motivation research. Market research in US began to be 
commercial: psychologists were not interested, so he switched to sociology. 
Did not aspire to academic job, and social research did not have 
institutions in which to work. Immigration problems led him to New York 
to begin work which led to establishment of University of Newark 
Research Center. 44 
Lazarsfeld, P. F. 1972 ‘The art of asking why’, in Qualitative Analysis: 
Historical and Critical Essays, Boston, Mass.: Allyn & Bacon, pP. 
183-202. Originally published in 1934 in The National Marketing 
Review. Summary of his Austrian work on the technique. Three rules: (1) 
Specify: ‘why’ can mean (a) what about product; (b) what influences; (c) 
what was wrong with old product. (2) Fit the questions to experience of 
Tespondent. Use different questions for different motivation patterns. (3) 
Bring out the tacit ‘as opposed to .. .’ assumptions; these may only be 
effectively tackled in experiments. Aim to get ‘the complete motivational 
set-up of the first degree’, (Compare this with Henry 1971; for a more 
up-to-date coverage of the Problem, see Kadushin 1968). 109 
Lazarsfeld, P. Е. and Menzel, H. 1961 ‘On the relationship between 
individual and collective Properties’, in A. Etzioni (ed.), Complex 
Organisations, New York: Holt, Rinehart & Winston, pp. 422-40. 61 _, 
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E^ .1972 Misunderstanding Verstehen’, Sociological Review, 20 (1. рр. 
9-38. Discusses meaning underlying a correlation. Criticises view a 
Verstehen is only important in generating hypotheses (Abel 1948). Abe 
restricts his comments to erklarendes Verstehen, and ignores aktuelles 
Verstehen. When interpreting a correlation between crop failure and low 
marriage rate, we use aktuelles Verstehen, and need to know what bot 
these things mean. Unless we know what these are, and mean, all we have 
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he © not accept correlations we do not understand as evidence of causa 
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Britain’, in Irvine et al. 1979, pp. 39-50. Mainly covers the dispute 
between Yule and Pearson over whether Q or tetrachoric r was the better 
measure for a 2 х 2 table. He traces Pearson’s position, and dominance, to 
his research programme on heredity and eugenics, although the author is 
careful to avoid the genetic fallacy. 40, 42 

Mackie, J. L. 1974 The Cement of the Universe: A Study of Causation, 
Oxford: Clarendon. 69 

MacKuen, M. B. 1979 ‘Social communication and the mass policy agenda’, 
Ph.D. dissertation, University of Michigan. 138 

Maclean, M. and Genn, H. 1979 Methodological Issues in Social Surveys, 
London: Macmillan. An account of how the design of a major screening 


survey into personal misfortunes was conceptualised and evolved. Dis- 
cusses alternative sources of data for a sampling frame, the development of 
dents, deciding between 


a screening instrument, the use of proxy respon 
Postal and personal inquiries and sample design. Probably more interest- 
ing to subject specialists than to general methodologists, despite authors’ 
claims and the title. 80 

McNemar, Q. 1946 *Opinion-attitude methodology’, Psychological Bulletin, 
43, pp. 289-374. A solicited review by a critical outsider with no vested 
interests into opinion-attitude methodologies. A classic on methodological 
problems of attitude research, stipulating three basic requirements of 
validity, reliability and unidimensionality. Replace single questions by 
scales. Get off campus. Do more experiments. Try more factor analysis. 
But the author is struck by how little basic = un work on 
attitudes being done in the big research institutes. 77, ) 
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